WO2024121928A1 - Information transfer system, transmission device, receiving device, information transfer method and program - Google Patents

Information transfer system, transmission device, receiving device, information transfer method and program Download PDF

Info

Publication number
WO2024121928A1
WO2024121928A1 PCT/JP2022/044879 JP2022044879W WO2024121928A1 WO 2024121928 A1 WO2024121928 A1 WO 2024121928A1 JP 2022044879 W JP2022044879 W JP 2022044879W WO 2024121928 A1 WO2024121928 A1 WO 2024121928A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
image information
dimensional code
processing unit
image
Prior art date
Application number
PCT/JP2022/044879
Other languages
French (fr)
Japanese (ja)
Inventor
秀明 田中
将志 田所
美沙 深井
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2022/044879 priority Critical patent/WO2024121928A1/en
Publication of WO2024121928A1 publication Critical patent/WO2024121928A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/12—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using a selected wavelength, e.g. to sense red marks and ignore blue marks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
    • G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
    • G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light

Definitions

  • One aspect of the present invention relates to an information transfer system that transfers information data from a sending side to a receiving side using a two-dimensional code, and a sending device, a receiving device, an information transfer method, and a program used in the system.
  • Two-dimensional codes are used, for example, to store high-density information data and display it on paper, allowing a viewer to view the information data by reading the two-dimensional code with a device equipped with a camera.
  • Two-dimensional codes are also used to add link information such as a URL (Uniform Resource Locator) to content displayed on a terminal display.
  • URL Uniform Resource Locator
  • the device reading the 2D code does not have a network access function, or if it has the function but is in an environment where it cannot access the network, communication will be one-way from the sending device to the receiving device, and it will be necessary to store and display the viewing information itself in the 2D code, rather than link information. In such cases, the size of the 2D code will increase, and the 2D code, which is supposed to be additional information, will overwhelm the display of the main information such as content, resulting in reduced visibility of the main information.
  • the sending device divides the additional information into multiple two-dimensional codes and displays these two-dimensional codes in time series as moving images, making it possible to display a large amount of additional information while reducing the size of the two-dimensional code (see, for example, non-patent document 1).
  • the display switching speed of the 2D code i.e. the frame rate
  • the receiving device may fail to read the 2D code displayed as the moving image, resulting in a decrease in the recognition rate of the 2D code.
  • the reason for this is thought to be that when the display of the 2D code is switched, parts of the previous and next images are mixed together when the image is read, causing the color of the cells in the image to be displayed as gray, an intermediate color between black and white, and making it impossible for the receiving device to correctly recognize these gray cells.
  • This invention was made with the above in mind, and aims to provide technology that makes it possible to improve data transfer efficiency while maintaining a high recognition rate.
  • the first aspect of the present invention involves, when transferring information to be transferred from a transmitting device to a receiving device using a two-dimensional code, first dividing the information to be transferred into a plurality of divided pieces of information in the transmitting device, setting a first display color and a second display color to a first divided piece of information and a second divided piece of information that are adjacent in the transfer order among the divided pieces of information, respectively, and sequentially displaying on a display device the two-dimensional code corresponding to the first divided piece of information to which the first display color has been set and the two-dimensional code corresponding to the second divided piece of information to which the second display color has been set in accordance with the transfer order at a preset display switching speed.
  • the receiving device acquires image information corresponding to each of the two-dimensional codes displayed sequentially on the display device from an imaging device, performs a filtering process for color-coding each of the acquired image information, and separates each of the image information into first image information corresponding to the first display color and second image information corresponding to the second display color. Then, the validity of the separated first image information and second image information is determined based on their image density, valid image information determined to be valid is selected, the two-dimensional code is reproduced based on the valid image information obtained for each of the image information, each of the reproduced two-dimensional codes is decoded to reproduce the multiple pieces of divided information, and the reproduced multiple pieces of divided information are combined to reproduce the information to be transferred.
  • the previous and next images are set to different display colors, making it possible to separate the previous and next images based on this difference in color. Then, for each of the separated image information, effective image information is selected based on its image density, and the two-dimensional code is reproduced based on the selected effective image information. Therefore, even if the display switching speed of the two-dimensional code is set to be fast, the receiving side can reproduce the two-dimensional code with a high recognition rate.
  • the density characteristics of pixels in the horizontal or vertical direction of the effective image information are detected, a binarization threshold is set for the horizontal or vertical direction according to the detected density characteristics, and the two-dimensional code is reproduced from the effective image information according to the set binarization threshold.
  • an optimal binarization threshold is set for the two-dimensional code image information to be binarized according to the horizontal or vertical density characteristics. This reduces the effects of the rolling shutter phenomenon, making it possible to convert the two-dimensional code image into a two-dimensional code with high accuracy.
  • one aspect of the present invention provides technology that enables improved data transfer efficiency while maintaining a high recognition rate.
  • FIG. 1 is a diagram showing an example of a configuration of an information transfer system according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing an example of a hardware configuration of a transmission device used in the information transfer system shown in FIG.
  • FIG. 3 is a block diagram showing an example of a software configuration of a transmission device used in the information transfer system shown in FIG.
  • FIG. 4 is a block diagram showing an example of a hardware configuration of a receiving device used in the information transfer system shown in FIG.
  • FIG. 5 is a block diagram showing an example of a software configuration of a receiving device used in the information transfer system shown in FIG.
  • FIG. 6 is a flowchart showing an example of the procedure and contents of a two-dimensional code display process executed by the control unit of the transmitting device shown in FIG.
  • FIG. 7 is a flowchart showing an example of the procedure and contents of the two-dimensional code reproduction process executed by the control unit of the receiving device shown in FIG.
  • FIG. 8 is a diagram showing an example of a two-dimensional code generated by the two-dimensional code display process shown in FIG.
  • FIG. 9 is a diagram showing an example of a two-dimensional code used to explain the color-based filtering process and the invalid code rejection process in the two-dimensional code reproduction process shown in FIG.
  • FIG. 10 is a diagram showing an example of a binarization threshold setting technique used to explain an example of the rolling shutter countermeasure binarization process in the two-dimensional code reproduction process shown in FIG.
  • FIG. 1 is a diagram showing an example of the configuration of an information transfer system according to an embodiment of the present invention.
  • the basic configuration is such that in the transmitting device TX, the information to be transferred, such as the content or its additional information, is divided into multiple parts, and the two-dimensional codes are displayed sequentially as moving images at a predetermined frame rate.
  • the image of each of the two-dimensional codes displayed as a moving image is read by a camera, and the two-dimensional codes are recognized from the images of each of the read two-dimensional codes, thereby reproducing the information to be transferred.
  • the transmission device TX is, for example, a personal computer.
  • a mobile terminal such as a smartphone or a tablet terminal may be used in addition to a personal computer.
  • FIGS. 2 and 3 are block diagrams showing examples of the hardware and software configurations of the transmitting device TX, respectively.
  • the transmitting device TX has a control unit 1 that uses a hardware processor such as a central processing unit (CPU), and a memory unit having a program memory unit 2 and a data memory unit 3, and an input/output interface unit 4 are connected to this control unit 1 via a bus 5.
  • a hardware processor such as a central processing unit (CPU)
  • a memory unit having a program memory unit 2 and a data memory unit 3, and an input/output interface unit 4 are connected to this control unit 1 via a bus 5.
  • I/F input/output interface
  • the input/output I/F unit 4 is connected to an input device 6 using a keyboard, mouse, etc., and a display device 7 using a liquid crystal display, etc.
  • the input/output I/F unit 4 has a function of taking in operation information inputted at the input device 6, and a function of outputting display information to the display device 7 for display.
  • a camera, an audio device, an external storage device, etc. may also be connected to the input/output I/F unit 4.
  • the input/output I/F unit 4 may also be provided with a communication I/F unit.
  • the communication I/F unit is used to transfer information between a server device on the web or cloud and other terminal devices via a network (not shown).
  • the program storage unit 2 is, for example, a combination of a non-volatile memory such as a solid state drive (SSD) as a storage medium that can be written to and read from at any time, and a non-volatile memory such as a read only memory (ROM), and stores application programs necessary to execute each control process according to one embodiment, in addition to middleware such as an operating system (OS).
  • OS operating system
  • the program will be collectively referred to as the program.
  • the data storage unit 3 is a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM (Random Access Memory), and the data storage unit 31 is provided in the storage area.
  • the data storage unit 31 is used to store information to be transferred, such as content and its additional information.
  • the control unit 1 includes, as processing functions necessary to implement one embodiment, a data division processing unit 11, a display color setting processing unit 12, a two-dimensional code generation processing unit 13, and a two-dimensional code display control processing unit 14. All of these processing units 11 to 14 are realized by causing the hardware processor of the control unit 1 to execute application programs stored in the program storage unit 2.
  • processing units 11 to 14 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).
  • LSI Large Scale Integration
  • ASIC Application Specific Integrated Circuit
  • the data division processing unit 11 divides the information to be transferred stored in the data storage unit 31 into multiple pieces of information for each predetermined data length. This division process generates multiple pieces of divided information.
  • the data length which is the unit of division, is set so that the display size of the two-dimensional code obtained by encoding each piece of divided information is a size that does not excessively restrict the display area of other display information.
  • the display color setting processing unit 12 sets a different display color for each of the multiple pieces of divided information.
  • the display colors are set so that when the two-dimensional codes of each piece of divided information are displayed sequentially as moving images, adjacent two-dimensional code images are displayed in different colors. For example, two colors from the RGB elements are alternately selected and set.
  • the two-dimensional code generation processing unit 13 generates, for each of the divided information, a two-dimensional code that represents the content of the divided information and has the display color set by the display color setting processing unit 12.
  • the two-dimensional code display control processing unit 14 sequentially displays the generated two-dimensional codes of each of the divided information on the display device 7 as a moving image at a preset display switching speed, i.e., frame rate.
  • the receiving device RX is, for example, a smartphone. Note that, as the receiving device RX, a tablet terminal, a personal computer, or the like may be used in addition to a smartphone. Also, as the receiving device RX, a camera without a web access function may be used.
  • FIGS. 4 and 5 are block diagrams showing examples of the hardware and software configurations of the receiving device RX, respectively.
  • the receiving device RX like the transmitting device TX, has a control unit 10 that uses a hardware processor such as a CPU, and is connected to this control unit 10 via a bus 50 with a storage unit having a program storage unit 20 and a data storage unit 30, and an input/output I/F unit 40.
  • a hardware processor such as a CPU
  • the input/output I/F unit 40 is connected to a UI device in which an input device 60 using a pressure-sensitive or capacitive touch-type input sheet is superimposed on the display screen of a display device 70 using, for example, a liquid crystal or organic electroluminescence.
  • the input/output I/F unit 40 takes in operation information inputted at the input device 60 and outputs display information to the display device 70 for display.
  • a camera 80 serving as an imaging device is connected to the input/output I/F unit 40.
  • the camera 80 is used to read the image of the two-dimensional code that is displayed as a moving image on the display device 7 of the transmission device TX.
  • the receiving device RX may also be equipped with a communication I/F unit for transferring information between a server device on the Web or cloud or other terminal devices via a network (not shown).
  • the program storage unit 20 uses, for example, a non-volatile memory such as an SSD as a storage medium that can be written to and read from at any time, and stores application programs necessary to execute each control process according to one embodiment, in addition to middleware such as an OS.
  • middleware such as an OS.
  • the OS and each application program will be collectively referred to as the program.
  • the data storage unit 30 is a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM, and the storage area includes a camera image storage unit 301 and a playback information storage unit 302.
  • the camera image storage unit 301 is used to store image data of the two-dimensional code captured by the camera.
  • the reproduced information storage unit 302 is used to store the information to be transferred that is reproduced by decoding and combining the two-dimensional code.
  • the control unit 10 includes, as processing functions necessary to implement one embodiment, a camera image acquisition processing unit 101, a two-dimensional code identification processing unit 102, a color-specific filtering processing unit 103, an invalid code rejection processing unit 104, a rolling shutter countermeasure binarization processing unit 105, and a decode processing unit 106. All of these processing units 101 to 106 are realized by causing the hardware processor of the control unit 10 to execute application programs stored in the program storage unit 20.
  • the camera image acquisition processing unit 101 captures video data of the two-dimensional code captured by the camera 80 via the input/output I/F unit 40, and temporarily stores the captured video data of the two-dimensional code in the camera image storage unit 301.
  • the two-dimensional code identification processing unit 102 identifies the two-dimensional code image for each frame from the image data stored in the camera image storage unit 301.
  • the color-specific filtering processing unit 103 performs color-specific filtering processing on the two-dimensional code image obtained for each frame to identify the two colors of the RGB elements, thereby separating the two-dimensional code image into two two-dimensional code images corresponding to each of the two colors of the RGB elements.
  • the invalid code rejection processing unit 104 judges whether each of the two-color two-dimensional code images separated by the color-specific filtering processing unit 103 is valid or invalid depending on its density. The invalid code rejection processing unit 104 then selects images that are judged to be valid, while rejecting images that are judged to be invalid. An example of the invalid code rejection processing will be described in the operation example.
  • the rolling shutter countermeasure binarization processing unit 105 detects the density characteristics of pixels in the horizontal or vertical direction for the two-dimensional code image determined to be valid, and sets a binarization threshold value for the horizontal or vertical direction according to the detected density characteristics. The rolling shutter countermeasure binarization processing unit 105 then binarizes the two-dimensional code image determined to be valid according to the set binarization threshold value, and recognizes the two-dimensional code.
  • This rolling countermeasure binarization processing will also be described in the operation example.
  • the decoding processing unit 106 decodes each of the recognized two-dimensional codes to reproduce the divided information, and combines the reproduced divided information to reproduce the information to be transferred. The decoding processing unit 106 then stores the reproduced information to be transferred in the reproduced information storage unit 302.
  • FIG. 6 is a flowchart showing an example of the processing procedure and processing contents of a two-dimensional code display processing executed by the control unit 1 of the transmission device TX.
  • the information to be transferred such as main information of the content or its additional information, is assumed to be created in advance within the transmitting device TX, or obtained from a website or the like, and stored in advance in the data storage unit 31.
  • the control unit 1 of the transmission device TX under the control of the data division processing unit 11, first determines the division number M of the information to be transferred in accordance with the constraint of the display size of the two-dimensional code in step S10. Then, in step S11, the information to be transferred stored in the data storage unit 31 is divided into the above M pieces of information. Note that the information to be transferred may be divided into M pieces of information in advance.
  • step S12 the control unit 1 of the transmission device TX monitors whether or not a display end request has been input from the user, and ends the process when the display end request is input. However, if the display end request is not input, the two-dimensional code generation and display process is executed as follows.
  • the control unit 1 of the transmission device TX first reads one piece of division information from the data storage unit 31 under the control of the display color setting processing unit 12. Then, in step S13, it is determined whether the display color set for the division information read one time before is "A" or "B". If the result of this determination is that the display color set for the division information one time before is "B", in step S14, the display color of the division information read this time is set to "A”. On the other hand, if the display color set for the division information one time before is "A”, in step S15, the display color of the division information read this time is set to "B". Note that for the division information read for the first time, the display color is set to, for example, "A" which is set as a default value.
  • step S16 under the control of the two-dimensional code generation processing unit 13, the control unit 1 of the transmitting device TX converts the divided information, whose display color has been set by the display color setting processing unit 12, into a two-dimensional code that represents the content of the divided information and reflects the display color.
  • step S17 the control unit 1 of the transmission device TX, under the control of the two-dimensional code display control processing unit 14, outputs the two-dimensional code generated by the two-dimensional code generation processing unit 13 to the display device 7 via the input/output I/F unit 4 and displays it.
  • the control unit 1 of the transmitting device TX waits for t seconds in step S18 each time a two-dimensional code for one piece of divided information is generated and displayed, and then returns to step S12 to generate and display a two-dimensional code for the next piece of divided information.
  • the two-dimensional codes for the divided information are displayed in sequence, like a moving image, at intervals of t seconds on the display device 7 of the transmitting device TX.
  • Figure 8 shows an example of the display result, in which the two-dimensional codes for each divided information are displayed alternately in the order "red”, “blue”, “red”, ....
  • FIG. 7 is a flowchart showing an example of the procedure and contents of a two-dimensional code reproduction process executed by the control unit 10 of the receiving device RX.
  • step S10 the control unit 10 of the receiving device RX monitors the user's operation to read the two-dimensional code. Then, when the control unit 10 detects the reading operation, it starts the camera 80 under the control of the camera image acquisition processing unit 101, and starts the reading process of the two-dimensional code displayed on the display device 7 of the transmitting device TX.
  • step S21 the control unit 10 of the receiving device RX sequentially imports video image data of the above two-dimensional code captured by the camera 80 via the input/output I/F unit 40 and stores it in the camera image storage unit 301.
  • the control unit 10 of the receiving device RX then reads the video data of the two-dimensional code from the camera image storage unit 301 frame by frame under the control of the two-dimensional code identification processing unit 102. Then, each frame image that has been read is binarized in step S22, and a two-dimensional code image is obtained in step S23.
  • the two-dimensional code identification processing unit 102 also detects a specific pattern of the two-dimensional code from each of the two-dimensional code images. For example, if the two-dimensional code is a QR code (registered trademark), it detects its finder pattern. Then, in step S24, it determines whether or not the finder pattern has been detected, and if not, it returns to step S21 via step S20, and repeats the acquisition of the camera image and the two-dimensional code identification process in steps S21 to S24.
  • QR code registered trademark
  • step S25 executes color filtering processing for each two-dimensional code image under the control of the color filtering processing unit 103 as follows.
  • the color-specific filtering processing unit 103 performs color-specific filtering processing to separate two colors (in this example, "red” and “blue") from the RGB elements used by the transmitting device TX to set the display color, thereby separating each of the two-dimensional code images into a two-dimensional code image having only the "red” color component and a two-dimensional code image having only the "blue” color component.
  • the above-mentioned color filtering process makes it possible to separate the two-dimensional code image of each frame into the two-dimensional code image of the current frame and the two-dimensional code image from one frame before.
  • the invalid code rejection processing unit 104 first converts the two-color two-dimensional code images into grayscale images in step S26.
  • step S27 the invalid code rejection processing unit 104 detects the pixel density of the two grayscaled two-dimensional code images, and determines whether the two two-dimensional code images are valid or invalid based on the detected pixel density. Then, it selects the two-dimensional code images that are determined to be valid, and rejects the two-dimensional code images that are determined to be invalid.
  • a finder pattern is detected from each two-dimensional code image, and the brightness of the pixels of the detected finder pattern is detected.
  • the brightness of the finder patterns is then compared between the two two-dimensional code images, and as a result of this comparison, the two-dimensional code image with the higher brightness, i.e., the lower density, is determined to be invalid and discarded.
  • the two-dimensional code image with the lower brightness i.e., the higher density
  • Figure 9 explains an example of a method for determining whether a two-dimensional code image is valid or invalid.
  • Vbr indicates the two-dimensional code image before it is separated by color
  • Vb and Vr indicate the "blue” and “red” two-dimensional code images after separation, respectively.
  • the total brightness values (b1+b2+b3) and (r1+r2+r3) of the respective finder patterns of the "blue" two-dimensional code image Vb and the "red” two-dimensional code image Vr are compared, and the "blue" two-dimensional code image Vb, which has a higher total brightness value, is rejected as an invalid code, and the "red" two-dimensional code image Vr, which has a lower total brightness value, is selected as a valid code.
  • the control unit 10 of the receiving device RX executes binarization processing that takes measures against rolling shutter as follows, under the control of the rolling shutter countermeasure binarization processing unit 105.
  • the rolling shutter countermeasure binarization processing unit 105 performs affine transformation in step S28, and then in step S29, sets a binarization threshold value for each of the horizontal and vertical directions (also called the column direction or row direction) of the two-dimensional code image to be binarized.
  • the rolling shutter countermeasure binarization processing unit 105 first detects the brightness c1, c2, and c3 of the pixels at the reference points of the finder patterns, for example as shown in FIG. 10. The rolling shutter countermeasure binarization processing unit 105 then compares the difference in brightness c1, c3 between the finder patterns in the horizontal direction x (c3-c1) with the difference in brightness c2, c1 between the finder patterns in the vertical direction y (c2-c1).
  • N-7 represents the number of pixels from reference point c2 (or reference point c3) of the finder pattern to reference point c1, and indicates that each reference point is located 4 pixels from the outer frame of the 2D code.
  • x-4 and y-4 indicate that the position of reference point c1 in the horizontal direction x or vertical direction y is 4 pixels.
  • the positions between reference points c1 and c2, and c1 and c3 are used as references, and the densities are calculated as threshold values Tx and Ty.
  • the rolling shutter countermeasure binarization processing unit 105 uses the thresholds Tx and Ty calculated as described above to binarize the two-dimensional code image to be binarized and reproduce the two-dimensional code data.
  • step S30 the control unit 10 of the receiving device RX receives the binarized 2D code data from the rolling shutter countermeasure binarization processing unit 105 under the control of the decoding processing unit 106, decodes the received 2D code data, and reproduces the division information. Then, the reproduced division information is temporarily stored in the reproduction information storage unit 302.
  • control unit 10 of the receiving device RX returns to step S21 via step S20, and executes the series of two-dimensional code reproduction processes from steps S21 to S30 again. After this, the control unit 10 of the receiving device RX repeatedly executes the processes from steps S21 to S30 until the reproduction process for all frames of the two-dimensional code image is completed.
  • step S31 the decoding processing unit 106 combines the divided information stored in the playback information storage unit 302 to reproduce the information to be transferred before it was divided. Then, the reproduced information to be transferred is stored in the playback information storage unit 302.
  • the reproduced information to be transferred is read from the reproduction information storage unit 302 in response to, for example, a user's display operation, and is displayed on the display device 70.
  • the transmission device TX sets two display colors that are alternately different for a plurality of divided information pieces obtained by dividing the information to be transferred, and displays the two-dimensional code corresponding to each divided information piece to which the different display colors are set on the display device 7 as a moving image at a predetermined frame rate.
  • the reception device RX reads the image of the two-dimensional code displayed on the display device 7 of the transmission device TX by the camera 80, and first performs color-specific filtering processing on the read two-dimensional code image to separate it into the two-dimensional code images of the two colors.
  • the separated two-dimensional code images of the two colors are judged to be valid/invalid based on their image density, and the two-dimensional code images judged to be valid are selected, and the two-dimensional code images judged to be invalid are rejected.
  • a binarization threshold value for a rolling shutter countermeasure is obtained, and the two-dimensional code image is binarized using the binarization threshold value to reproduce the two-dimensional code data.
  • the reproduced two-dimensional code data is decoded to reproduce the divided information, and finally, the plurality of divided information pieces are combined to reproduce the original information to be transferred.
  • the previous and next two-dimensional code images are set to different display colors, making it possible to separate the previous and next images based on this color difference. Then, for each of the separated two-dimensional code images, a valid two-dimensional code image is selected based on its image density, and the two-dimensional code is reproduced based on the selected two-dimensional code image. Therefore, even if the display switching speed of the two-dimensional code is set to be fast, the receiving device RX can reproduce the two-dimensional code with a high recognition rate.
  • an optimal binarization threshold is set for the two-dimensional code image to be binarized according to the horizontal or vertical density characteristics. This reduces the effects of the rolling shutter phenomenon, making it possible to convert the two-dimensional code image into a two-dimensional code with high accuracy.
  • this invention is not limited to the above-described embodiment as it is, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention.
  • various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • General Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)

Abstract

One aspect of the present invention pertains to a transmission device in which different display colors are set for units of divided information which have an adjacent transfer sequence from among a plurality of units of divided information obtained by dividing information to be transferred, and two-dimensional codes which correspond to the units of divided information for which the different display colors were set are sequentially displayed on a display device at a pre-set display switching speed according to the transfer order. Meanwhile, a receiving device first subjects each unit of image information of said two-dimensional codes which are sequentially displayed on the display device to separation by display color by performing filtering processing for color separation. Validity is determined for the separated image information on the basis of the image concentration, the information determined to be valid is selected as valid image information, and the two-dimensional codes are played back on the basis of the valid image information.

Description

情報転送システム、送信装置、受信装置、情報転送方法およびプログラムInformation transfer system, transmitting device, receiving device, information transfer method and program
　この発明の一態様は、送信側から受信側へ二次元コードを用いて情報データを転送する情報転送システムと、このシステムで使用される送信装置、受信装置、情報転送方法およびプログラムに関する。 One aspect of the present invention relates to an information transfer system that transfers information data from a sending side to a receiving side using a two-dimensional code, and a sending device, a receiving device, an information transfer method, and a program used in the system.
　二次元コードは、例えば、高密度の情報データを格納して紙面に表示し、この二次元コードをカメラを備えるデバイスにより読み取ることで、閲覧者が上記情報データを閲覧できるようにする目的で利用される。また二次元コードは、端末のディスプレイに表示されるコンテンツに対しＵＲＬ（Uniform Resource Locator）等のリンク情報を付加する目的でも利用される。 Two-dimensional codes are used, for example, to store high-density information data and display it on paper, allowing a viewer to view the information data by reading the two-dimensional code with a device equipped with a camera. Two-dimensional codes are also used to add link information such as a URL (Uniform Resource Locator) to content displayed on a terminal display.
　しかし、二次元コードを読み取るデバイスがネットワークアクセス機能を持たない場合や、アクセス機能を持っていてもネットワークにアクセスできない環境下にある場合には、送信側の装置から受信側の装置への片方向通信となるため、二次元コードにはリンク情報ではなく、閲覧情報そのものを格納して表示させることが必要になる。このような場合、二次元コードのサイズが大型化するため、付加的な情報であるはずの二次元コードがコンテンツなどの主情報の表示を圧迫して主情報の視認性の低下を招く。 However, if the device reading the 2D code does not have a network access function, or if it has the function but is in an environment where it cannot access the network, communication will be one-way from the sending device to the receiving device, and it will be necessary to store and display the viewing information itself in the 2D code, rather than link information. In such cases, the size of the 2D code will increase, and the 2D code, which is supposed to be additional information, will overwhelm the display of the main information such as content, resulting in reduced visibility of the main information.
　そこで、送信側の装置において、付加的な情報を複数の二次元コードに分割し、これらの二次元コードを動画像として時系列上で表示することで、二次元コードのサイズを小型化した上で大容量の付加的情報の表示を可能にする技術が提案されている（例えば非特許文献１を参照）。 Therefore, a technology has been proposed in which the sending device divides the additional information into multiple two-dimensional codes and displays these two-dimensional codes in time series as moving images, making it possible to display a large amount of additional information while reducing the size of the two-dimensional code (see, for example, non-patent document 1).
　ところが、二次元コードを動画像として短時間に効率よく表示するために二次元コードの表示切替速度、つまりフレームレートを増加させると、受信側の装置が上記動画像として表示される二次元コードの読み取りに失敗して、二次元コードの認識率の低下を招く心配がある。その原因は、二次元コードの表示切替タイミングにおいて、画像を読み取った際に前後の画像の一部が混在し、これにより画像のセルの色が黒と白との間の中間色である灰色として表示され、受信側がこの灰色セルを正しく認識できなくなるからと想定される。 However, if the display switching speed of the 2D code, i.e. the frame rate, is increased in order to efficiently display the 2D code as a moving image in a short time, there is a concern that the receiving device may fail to read the 2D code displayed as the moving image, resulting in a decrease in the recognition rate of the 2D code. The reason for this is thought to be that when the display of the 2D code is switched, parts of the previous and next images are mixed together when the image is read, causing the color of the cells in the image to be displayed as gray, an intermediate color between black and white, and making it impossible for the receiving device to correctly recognize these gray cells.
　また、受信側のカメラが表示画像のフレームを上辺から下辺に向かって順次走査することで画像を読み取る方式を採用している場合、フレーム内の走査位置により読み取りタイミングに時間差が発生する。これは、ローリングシャッタ現象と呼ばれる。このローリングシャッタ現象が発生すると、二次元コードを読み取る際に、１フレーム内の走査位置により灰色セルが発生して、これが認識率の低下の原因の１つとなる。なお、ローリングシャッタ現象については、以下のサイト
　　　インターネット＜URL: https://www.klv.co.jp/corner/what-is-shutter.html＞
に詳しく記載されている。 In addition, when the receiving camera reads images by sequentially scanning the frame of the displayed image from the top to the bottom, a time difference occurs in the reading timing depending on the scanning position within the frame. This is called the rolling shutter phenomenon. When this rolling shutter phenomenon occurs, gray cells appear depending on the scanning position within one frame when reading a two-dimensional code, which is one of the causes of a decrease in the recognition rate. For more information on the rolling shutter phenomenon, please refer to the following website Internet: URL: https://www.klv.co.jp/corner/what-is-shutter.html
is described in detail in.
　この発明は上記事情に着目してなされたもので、認識率を高く維持しつつデータ転送効率の向上を可能にする技術を提供しようとするものである。 This invention was made with the above in mind, and aims to provide technology that makes it possible to improve data transfer efficiency while maintaining a high recognition rate.
　上記課題を解決するためにこの発明の第１の態様は、送信装置から受信装置へ転送対象情報を二次元コードを用いて転送する際に、先ず前記送信装置において、前記転送対象情報を複数の分割情報に分割し、前記分割情報のうち転送順序が隣り合う第１の分割情報および第２の分割情報に対しそれぞれ第１の表示色および第２の表示色を設定し、前記第１の表示色が設定された前記第１の分割情報に対応する前記二次元コードと、前記第２の表示色が設定された前記第２の分割情報に対応する前記二次元コードとを、前記転送順序に従い予め設定された表示切替速度で表示デバイスに順次表示する。 In order to solve the above problem, the first aspect of the present invention involves, when transferring information to be transferred from a transmitting device to a receiving device using a two-dimensional code, first dividing the information to be transferred into a plurality of divided pieces of information in the transmitting device, setting a first display color and a second display color to a first divided piece of information and a second divided piece of information that are adjacent in the transfer order among the divided pieces of information, respectively, and sequentially displaying on a display device the two-dimensional code corresponding to the first divided piece of information to which the first display color has been set and the two-dimensional code corresponding to the second divided piece of information to which the second display color has been set in accordance with the transfer order at a preset display switching speed.
　一方、前記受信装置では、前記表示デバイスに順次表示された前記二次元コードの各々に対応する画像情報を撮像デバイスから取得し、取得した前記画像情報の各々に対し色分けのためのフィルタリング処理を行って、前記画像情報の各々を前記第１の表示色に対応する第１の画像情報と前記第２の表示色に対応する第２の画像情報とに分離する。そして、分離された前記第１の画像情報および前記第２の画像情報についてその画像濃度をもとに有効性を判定して、有効と判定した有効画像情報を選択し、前記画像情報の各々について得られた前記有効画像情報をもとにそれぞれ前記二次元コードを再生して、再生した前記二次元コードの各々をデコードして複数の前記分割情報を再生し、再生した複数の前記分割情報を結合して前記転送対象情報を再生する。 　Meanwhile, the receiving device acquires image information corresponding to each of the two-dimensional codes displayed sequentially on the display device from an imaging device, performs a filtering process for color-coding each of the acquired image information, and separates each of the image information into first image information corresponding to the first display color and second image information corresponding to the second display color. Then, the validity of the separated first image information and second image information is determined based on their image density, valid image information determined to be valid is selected, the two-dimensional code is reproduced based on the valid image information obtained for each of the image information, each of the reproduced two-dimensional codes is decoded to reproduce the multiple pieces of divided information, and the reproduced multiple pieces of divided information are combined to reproduce the information to be transferred.
　この発明の第１の態様によれば、二次元コードの表示切替タイミングにおいて、上記二次元コードの画像を読み取った際にその前後の画像の一部が混在しても、前後の画像が異なる表示色に設定されているため、この色の違いもとに前後の画像を分離することが可能となる。そして、分離された上記各画像情報についてその画像濃度をもとに有効な画像情報が選択され、選択された上記有効画像情報をもとに二次元コードが再生される。従って、二次元コードの表示切替速度を速く設定しても、受信側では高い認識率で二次元コードを再生することが可能となる。 According to the first aspect of the invention, even if parts of the previous and next images are mixed when the image of the two-dimensional code is read at the timing of display switching of the two-dimensional code, the previous and next images are set to different display colors, making it possible to separate the previous and next images based on this difference in color. Then, for each of the separated image information, effective image information is selected based on its image density, and the two-dimensional code is reproduced based on the selected effective image information. Therefore, even if the display switching speed of the two-dimensional code is set to be fast, the receiving side can reproduce the two-dimensional code with a high recognition rate.
　また、この発明の第２の態様は、前記有効画像情報をもとに前記二次元コードを再生する際に、前記有効画像情報についてその水平方向または垂直方向における画素の濃度特性を検出し、検出した前記濃度特性に応じて前記水平方向または前記垂直方向に対し二値化閾値を設定し、設定した前記二値化閾値に従い前記有効画像情報から前記二次元コードに再生する。 In addition, in a second aspect of the present invention, when reproducing the two-dimensional code based on the effective image information, the density characteristics of pixels in the horizontal or vertical direction of the effective image information are detected, a binarization threshold is set for the horizontal or vertical direction according to the detected density characteristics, and the two-dimensional code is reproduced from the effective image information according to the set binarization threshold.
　この発明の第２の態様によれば、二次元コードを撮像デバイスにより撮像する際にローリングシャッタ現象が発生しても、二値化対象の二次元コード画像情報に対し水平方向または垂直方向の濃度特性に応じて最適な二値化しきい値が設定される。このため、上記ローリングシャッタ現象の影響が低減され、これにより二次元コード画像を高精度に二次元コードに変換することが可能となる。 According to the second aspect of the present invention, even if the rolling shutter phenomenon occurs when capturing an image of a two-dimensional code using an imaging device, an optimal binarization threshold is set for the two-dimensional code image information to be binarized according to the horizontal or vertical density characteristics. This reduces the effects of the rolling shutter phenomenon, making it possible to convert the two-dimensional code image into a two-dimensional code with high accuracy.
　すなわちこの発明の一態様によれば、認識率を高く維持しつつデータ転送効率の向上を可能にする技術を提供することができる。 In other words, one aspect of the present invention provides technology that enables improved data transfer efficiency while maintaining a high recognition rate.
図１は、この発明の一実施形態に係る情報転送システムの構成の一例を示す図である。FIG. 1 is a diagram showing an example of a configuration of an information transfer system according to an embodiment of the present invention. 図２は、図１に示した情報転送システムで使用される送信装置のハードウェア構成の一例を示すブロック図である。FIG. 2 is a block diagram showing an example of a hardware configuration of a transmission device used in the information transfer system shown in FIG. 図３は、図１に示した情報転送システムで使用される送信装置のソフトウェア構成の一例を示すブロック図である。FIG. 3 is a block diagram showing an example of a software configuration of a transmission device used in the information transfer system shown in FIG. 図４は、図１に示した情報転送システムで使用される受信装置のハードウェア構成の一例を示すブロック図である。FIG. 4 is a block diagram showing an example of a hardware configuration of a receiving device used in the information transfer system shown in FIG. 図５は、図１に示した情報転送システムで使用される受信装置のソフトウェア構成の一例を示すブロック図である。FIG. 5 is a block diagram showing an example of a software configuration of a receiving device used in the information transfer system shown in FIG. 図６は、図３に示した送信装置の制御部が実行する二次元コード表示処理の処理手順と処理内容の一例を示すフローチャートである。FIG. 6 is a flowchart showing an example of the procedure and contents of a two-dimensional code display process executed by the control unit of the transmitting device shown in FIG. 図７は、図５に示した受信装置の制御部が実行する二次元コード再生処理の処理手順と処理内容の一例を示すフローチャートである。FIG. 7 is a flowchart showing an example of the procedure and contents of the two-dimensional code reproduction process executed by the control unit of the receiving device shown in FIG. 図８は、図６に示した二次元コード表示処理により生成される二次元コードの一例を示す図である。FIG. 8 is a diagram showing an example of a two-dimensional code generated by the two-dimensional code display process shown in FIG. 図９は、図７に示した二次元コード再生処理において色別フィルタリング処理および無効コード棄却処理を説明するために用いる二次元コードの一例を示す図である。FIG. 9 is a diagram showing an example of a two-dimensional code used to explain the color-based filtering process and the invalid code rejection process in the two-dimensional code reproduction process shown in FIG. 図１０は、図７に示した二次元コード再生処理においてローリングシャッタ対策二値化処理の一例を説明するために用いる二値化しきい値設定手法の一例を示す図である。FIG. 10 is a diagram showing an example of a binarization threshold setting technique used to explain an example of the rolling shutter countermeasure binarization process in the two-dimensional code reproduction process shown in FIG.
　以下、図面を参照してこの発明に係わる実施形態を説明する。 Below, an embodiment of the present invention will be described with reference to the drawings.
　［一実施形態］
　（構成例）
　（１）システム
　図１は、この発明の一実施形態に係る情報転送システムの構成の一例を示す図である。 [One embodiment]
(Configuration example)
(1) System FIG. 1 is a diagram showing an example of the configuration of an information transfer system according to an embodiment of the present invention.
　一実施形態の情報転送システムは、基本構成として、送信装置ＴＸにおいて、コンテンツまたはその付加情報等の転送対象情報を複数に分割して、その二次元コードを動画像として所定のフレームレートで順次表示する。これに対し受信装置ＲＸでは、動画像として表示された上記各二次元コードの画像をカメラにより読み取り、読み取った各二次元コードの画像から上記二次元コードを認識して上記転送対象情報を再生するものである。 In one embodiment of the information transfer system, the basic configuration is such that in the transmitting device TX, the information to be transferred, such as the content or its additional information, is divided into multiple parts, and the two-dimensional codes are displayed sequentially as moving images at a predetermined frame rate. In response to this, in the receiving device RX, the image of each of the two-dimensional codes displayed as a moving image is read by a camera, and the two-dimensional codes are recognized from the images of each of the read two-dimensional codes, thereby reproducing the information to be transferred.
　（２）送信装置ＴＸ
　送信装置ＴＸは、例えばパーソナルコンピュータからなる。なお、送信装置ＴＸとしては、パーソナルコンピュータ以外に、スマートフォンやタブレット型端末等の携帯端末が使用されてもよい。 (2) Transmitter TX
The transmission device TX is, for example, a personal computer. Note that, as the transmission device TX, a mobile terminal such as a smartphone or a tablet terminal may be used in addition to a personal computer.
　図２および図３は、それぞれ送信装置ＴＸのハードウェア構成およびソフトウェア構成の一例を示すブロック図である。 FIGS. 2 and 3 are block diagrams showing examples of the hardware and software configurations of the transmitting device TX, respectively.
　送信装置ＴＸは、中央処理ユニット（Central Processing Unit：ＣＰＵ）等のハードウェアプロセッサを使用した制御部１を備え、この制御部１に対し、バス５を介して、プログラム記憶部２およびデータ記憶部３を有する記憶ユニットと、入出力インタフェース部４とをそれぞれ接続したものとなっている。なお、以後インタフェースをＩ／Ｆと略称する。 The transmitting device TX has a control unit 1 that uses a hardware processor such as a central processing unit (CPU), and a memory unit having a program memory unit 2 and a data memory unit 3, and an input/output interface unit 4 are connected to this control unit 1 via a bus 5. Note that hereafter, the interface will be abbreviated to I/F.
　入出力Ｉ／Ｆ部４には、キーボードおよびマウス等を用いた入力デバイス６と、液晶ディスプレイ等を用いた表示デバイス７が接続される。入出力Ｉ／Ｆ部４は、入力デバイス６において入力された操作情報を取り込む機能と、表示情報を表示デバイス７へ出力して表示させる機能とを有する。 The input/output I/F unit 4 is connected to an input device 6 using a keyboard, mouse, etc., and a display device 7 using a liquid crystal display, etc. The input/output I/F unit 4 has a function of taking in operation information inputted at the input device 6, and a function of outputting display information to the display device 7 for display.
　なお、入出力Ｉ／Ｆ部４には、他にカメラや音響デバイス、外部記憶デバイス等が接続されてもよい。また、入出力Ｉ／Ｆ部４には、通信Ｉ／Ｆ部が設けられていてもよい。通信Ｉ／Ｆ部は、図示しないネットワークを介してＷｅｂ上またはクラウド上のサーバ装置や他の端末装置との間で情報転送を行うために使用される。 In addition, a camera, an audio device, an external storage device, etc. may also be connected to the input/output I/F unit 4. The input/output I/F unit 4 may also be provided with a communication I/F unit. The communication I/F unit is used to transfer information between a server device on the web or cloud and other terminal devices via a network (not shown).
　プログラム記憶部２は、例えば、記憶媒体としてＳＳＤ（Solid State Drive）等の随時書込みおよび読出しが可能な不揮発性メモリと、ＲＯＭ（Read Only Memory）等の不揮発性メモリとを組み合わせたもので、ＯＳ（Operating System）等のミドルウェアに加えて、一実施形態に係る各制御処理を実行するために必要なアプリケーション・プログラムを格納する。なお、以後ＯＳと各アプリケーション・プログラムとをまとめてプログラムと称する。 The program storage unit 2 is, for example, a combination of a non-volatile memory such as a solid state drive (SSD) as a storage medium that can be written to and read from at any time, and a non-volatile memory such as a read only memory (ROM), and stores application programs necessary to execute each control process according to one embodiment, in addition to middleware such as an operating system (OS). Hereinafter, the OS and each application program will be collectively referred to as the program.
　データ記憶部３は、例えば、ＳＳＤ等の随時書込みおよび読出しが可能な不揮発性メモリと、ＲＡＭ（Random Access Memory）等の揮発性メモリと組み合わせたもので、その記憶領域には、データ記憶部３１が設けられる。データ記憶部３１は、コンテンツやその付加情報等の転送対象情報を記憶するために使用される。 The data storage unit 3 is a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM (Random Access Memory), and the data storage unit 31 is provided in the storage area. The data storage unit 31 is used to store information to be transferred, such as content and its additional information.
　制御部１は、一実施形態を実施するために必要な処理機能として、データ分割処理部１１と、表示色設定処理部１２と、二次元コード生成処理部１３と、二次元コード表示制御処理部１４とを備える。これらの処理部１１～１４は、何れもプログラム記憶部２に格納されたアプリケーション・プログラムを制御部１のハードウェアプロセッサに実行させることにより実現される。 The control unit 1 includes, as processing functions necessary to implement one embodiment, a data division processing unit 11, a display color setting processing unit 12, a two-dimensional code generation processing unit 13, and a two-dimensional code display control processing unit 14. All of these processing units 11 to 14 are realized by causing the hardware processor of the control unit 1 to execute application programs stored in the program storage unit 2.
　なお、上記各処理部１１～１４の一部または全部は、ＬＳＩ（Large Scale Integration）やＡＳＩＣ（Application Specific Integrated Circuit）等のハードウェアを用いて実現されてもよい。 In addition, some or all of the above processing units 11 to 14 may be realized using hardware such as an LSI (Large Scale Integration) or an ASIC (Application Specific Integrated Circuit).
　データ分割処理部１１は、データ記憶部３１に記憶された転送対象情報を所定のデータ長ごとに複数の情報に分割する。この分割処理により複数の分割情報が生成される。分割の単位となる上記データ長は、例えば各分割情報をコード化して得られる二次元コードの表示サイズが、他の表示情報の表示領域に過度の制約を与えない程度のサイズとなるように設定される。 The data division processing unit 11 divides the information to be transferred stored in the data storage unit 31 into multiple pieces of information for each predetermined data length. This division process generates multiple pieces of divided information. The data length, which is the unit of division, is set so that the display size of the two-dimensional code obtained by encoding each piece of divided information is a size that does not excessively restrict the display area of other display information.
　表示色設定処理部１２は、上記複数の分割情報の各々に対し異なる表示色を設定する。表示色は、上記各分割情報の二次元コードを動画像として順次表示する際に、表示順序が隣り合う二次元コードの画像間で互いに異なる色になるように設定される。例えば、ＲＧＢ要素のうちの２色が交互に選択され設定される。 The display color setting processing unit 12 sets a different display color for each of the multiple pieces of divided information. The display colors are set so that when the two-dimensional codes of each piece of divided information are displayed sequentially as moving images, adjacent two-dimensional code images are displayed in different colors. For example, two colors from the RGB elements are alternately selected and set.
　二次元コード生成処理部１３は、上記分割情報の各々について、当該分割情報の内容を表しかつ上記表示色設定処理部１２により設定された表示色を有する二次元コードを生成する。 The two-dimensional code generation processing unit 13 generates, for each of the divided information, a two-dimensional code that represents the content of the divided information and has the display color set by the display color setting processing unit 12.
　二次元コード表示制御処理部１４は、生成された上記各分割情報の二次元コードを、予め設定された表示切替速度、つまりフレームレートで、動画像として表示デバイス７に順次表示する。 The two-dimensional code display control processing unit 14 sequentially displays the generated two-dimensional codes of each of the divided information on the display device 7 as a moving image at a preset display switching speed, i.e., frame rate.
　（３）受信装置ＲＸ
　受信装置ＲＸは、例えばスマートフォンにより構成される。なお、受信装置ＲＸとしては、スマートフォン以外にタブレット型端末やパーソナルコンピュータ等が使用されてもよい。また、受信装置ＲＸとしては、Ｗｅｂアクセス機能を持たないカメラが用いられてもよい。 (3) Receiving device RX
The receiving device RX is, for example, a smartphone. Note that, as the receiving device RX, a tablet terminal, a personal computer, or the like may be used in addition to a smartphone. Also, as the receiving device RX, a camera without a web access function may be used.
　図４および図５は、それぞれ受信装置ＲＸのハードウェア構成およびソフトウェア構成の一例を示すブロック図である。 FIGS. 4 and 5 are block diagrams showing examples of the hardware and software configurations of the receiving device RX, respectively.
　受信装置ＲＸは、送信装置ＴＸと同様にＣＰＵ等のハードウェアプロセッサを使用した制御部１０を備え、この制御部１０に対し、バス５０を介して、プログラム記憶部２０およびデータ記憶部３０を有する記憶ユニットと、入出力Ｉ／Ｆ部４０とをそれぞれ接続したものとなっている。 The receiving device RX, like the transmitting device TX, has a control unit 10 that uses a hardware processor such as a CPU, and is connected to this control unit 10 via a bus 50 with a storage unit having a program storage unit 20 and a data storage unit 30, and an input/output I/F unit 40.
　入出力Ｉ／Ｆ部４０には、例えば液晶または有機ＥＬを使用する表示デバイス７０の表示画面上に、感圧式または静電容量式のタッチ型入力シートを使用する入力デバイス６０を重ねて配置したＵＩデバイスが接続される。入出力Ｉ／Ｆ部４０は、入力デバイス６０において入力された操作情報を取り込むと共に、表示情報を表示デバイス７０へ出力して表示する。 The input/output I/F unit 40 is connected to a UI device in which an input device 60 using a pressure-sensitive or capacitive touch-type input sheet is superimposed on the display screen of a display device 70 using, for example, a liquid crystal or organic electroluminescence. The input/output I/F unit 40 takes in operation information inputted at the input device 60 and outputs display information to the display device 70 for display.
　また、入出力Ｉ／Ｆ部４０には、撮像デバイスとしてのカメラ８０が接続される。カメラ８０は、上記送信装置ＴＸの表示デバイス７に動画像として表示される二次元コードの画像を読み取るために使用される。 In addition, a camera 80 serving as an imaging device is connected to the input/output I/F unit 40. The camera 80 is used to read the image of the two-dimensional code that is displayed as a moving image on the display device 7 of the transmission device TX.
　なお、受信装置ＲＸは、図示しないネットワークを介してＷｅｂ上またはクラウド上のサーバ装置や他の端末装置との間で情報転送を行うための通信Ｉ／Ｆ部が備えられていてもよい。 The receiving device RX may also be equipped with a communication I/F unit for transferring information between a server device on the Web or cloud or other terminal devices via a network (not shown).
　プログラム記憶部２０は、例えば、記憶媒体としてＳＳＤ等の随時書込みおよび読出しが可能な不揮発性メモリを用いたもので、ＯＳ等のミドルウェアに加えて、一実施形態に係る各制御処理を実行するために必要なアプリケーション・プログラムを格納する。なお、以後ＯＳと各アプリケーション・プログラムとをまとめてプログラムと称する。 The program storage unit 20 uses, for example, a non-volatile memory such as an SSD as a storage medium that can be written to and read from at any time, and stores application programs necessary to execute each control process according to one embodiment, in addition to middleware such as an OS. Hereinafter, the OS and each application program will be collectively referred to as the program.
　データ記憶部３０は、例えば、ＳＳＤ等の随時書込みおよび読出しが可能な不揮発性メモリと、ＲＡＭ等の揮発性メモリと組み合わせたもので、その記憶領域には、カメラ画像記憶部３０１と、再生情報記憶部３０２とが設けられる。 The data storage unit 30 is a combination of a non-volatile memory such as an SSD that can be written to and read from at any time, and a volatile memory such as a RAM, and the storage area includes a camera image storage unit 301 and a playback information storage unit 302.
　カメラ画像記憶部３０１は、上記カメラにより撮像された二次元コードの画像データを記憶するために使用される。再生情報記憶部３０２は、二次元コードをデコードしさらに結合することにより再生された転送対象情報を記憶するために使用される。 The camera image storage unit 301 is used to store image data of the two-dimensional code captured by the camera. The reproduced information storage unit 302 is used to store the information to be transferred that is reproduced by decoding and combining the two-dimensional code.
　制御部１０は、一実施形態を実施するために必要な処理機能として、カメラ画像取得処理部１０１と、二次元コード識別処理部１０２と、色別フィルタリング処理部１０３と、無効コード棄却処理部１０４と、ローリングシャッタ対策二値化処理部１０５と、デコード処理部１０６とを備える。これらの処理部１０１～１０６は、何れもプログラム記憶部２０に格納されたアプリケーション・プログラムを制御部１０のハードウェアプロセッサに実行させることにより実現される。 The control unit 10 includes, as processing functions necessary to implement one embodiment, a camera image acquisition processing unit 101, a two-dimensional code identification processing unit 102, a color-specific filtering processing unit 103, an invalid code rejection processing unit 104, a rolling shutter countermeasure binarization processing unit 105, and a decode processing unit 106. All of these processing units 101 to 106 are realized by causing the hardware processor of the control unit 10 to execute application programs stored in the program storage unit 20.
　カメラ画像取得処理部１０１は、カメラ８０により撮像された二次元コードの動画像データを入出力Ｉ／Ｆ部４０を介して取り込み、取り込んだ上記二次元コードの動画像データをカメラ画像記憶部３０１に一時記憶する。 The camera image acquisition processing unit 101 captures video data of the two-dimensional code captured by the camera 80 via the input/output I/F unit 40, and temporarily stores the captured video data of the two-dimensional code in the camera image storage unit 301.
　二次元コード識別処理部１０２は、上記カメラ画像記憶部３０１に記憶された上記画像データからフレームごとに二次元コード画像を識別する。 The two-dimensional code identification processing unit 102 identifies the two-dimensional code image for each frame from the image data stored in the camera image storage unit 301.
　色別フィルタリング処理部１０３は、フレームごとに得られた上記二次元コード画像に対し、それぞれＲＧＢ要素の２色を識別するための色別フィルタリング処理を行い、これにより上記二次元コード画像をＲＧＢ要素の２色の各々に対応する２個の二次元コード画像に分離する。 The color-specific filtering processing unit 103 performs color-specific filtering processing on the two-dimensional code image obtained for each frame to identify the two colors of the RGB elements, thereby separating the two-dimensional code image into two two-dimensional code images corresponding to each of the two colors of the RGB elements.
　無効コード棄却処理部１０４は、上記色別フィルタリング処理部１０３により分離された上記２色の二次元コード画像の各々に対し、その濃度に応じて有効／無効を判定する。そして、無効コード棄却処理部１０４は、有効と判定された画像を選択し、一方無効と判定された画像を棄却する処理を行う。なお、上記無効コード棄却処理の一例は、動作例において説明する。 The invalid code rejection processing unit 104 judges whether each of the two-color two-dimensional code images separated by the color-specific filtering processing unit 103 is valid or invalid depending on its density. The invalid code rejection processing unit 104 then selects images that are judged to be valid, while rejecting images that are judged to be invalid. An example of the invalid code rejection processing will be described in the operation example.
　ローリングシャッタ対策二値化処理部１０５は、有効と判定された上記二次元コード画像についてその水平方向または垂直方向における画素の濃度特性を検出し、検出した上記濃度特性に応じて上記水平方向または垂直方向に対し二値化しきい値を設定する。そして、ローリングシャッタ対策二値化処理部１０５は、設定した上記二値化しきい値に従い、上記有効と判定された二次元コード画像を二値化して二次元コードを認識する。このローリング対策二値化処理の一例についても動作例において説明する。 The rolling shutter countermeasure binarization processing unit 105 detects the density characteristics of pixels in the horizontal or vertical direction for the two-dimensional code image determined to be valid, and sets a binarization threshold value for the horizontal or vertical direction according to the detected density characteristics. The rolling shutter countermeasure binarization processing unit 105 then binarizes the two-dimensional code image determined to be valid according to the set binarization threshold value, and recognizes the two-dimensional code. An example of this rolling countermeasure binarization processing will also be described in the operation example.
　デコード処理部１０６は、認識された各二次元コードをそれぞれデコードして上記分割情報を再生し、再生した上記分割情報を結合して転送対象情報を再生する。そして、デコード処理部１０６は、再生した上記転送対象情報を再生情報記憶部３０２に記憶する。 The decoding processing unit 106 decodes each of the recognized two-dimensional codes to reproduce the divided information, and combines the reproduced divided information to reproduce the information to be transferred. The decoding processing unit 106 then stores the reproduced information to be transferred in the reproduced information storage unit 302.
　（動作例）
　次に、以上のように構成された情報転送システムの動作例を説明する。 (Example of operation)
Next, an example of the operation of the information transfer system configured as above will be described.
　（１）送信装置ＴＸの動作
　図６は、送信装置ＴＸの制御部１が実行する二次元コード表示処理の処理手順と処理内容の一例を示すフローチャートである。 (1) Operation of the Transmission Device TX FIG. 6 is a flowchart showing an example of the processing procedure and processing contents of a two-dimensional code display processing executed by the control unit 1 of the transmission device TX.
　なお、この例では、コンテンツ等の主情報またはその付加情報等の転送対象情報が、例えば送信装置ＴＸ内で事前に作成されるか、またはＷｅｂサイト等から取得されて、データ記憶部３１に事前に記憶されているものとして説明を行う。 In this example, the information to be transferred, such as main information of the content or its additional information, is assumed to be created in advance within the transmitting device TX, or obtained from a website or the like, and stored in advance in the data storage unit 31.
　（１－１）転送対象情報の分割
　送信装置ＴＸの制御部１は、データ分割処理部１１の制御の下、先ずステップＳ１０において、二次元コードの表示サイズの制約に応じて転送対象情報の分割数Ｍを求める。そして、ステップＳ１１において、データ記憶部３１に記憶された転送対象情報を、上記Ｍ個の情報に分割する。なお、転送対象情報は事前にＭ個の情報に分割されていてもよい。 (1-1) Division of information to be transferred The control unit 1 of the transmission device TX, under the control of the data division processing unit 11, first determines the division number M of the information to be transferred in accordance with the constraint of the display size of the two-dimensional code in step S10. Then, in step S11, the information to be transferred stored in the data storage unit 31 is divided into the above M pieces of information. Note that the information to be transferred may be divided into M pieces of information in advance.
　（１－２）表示色の設定
　送信装置ＴＸの制御部１は、ステップＳ１２において、ユーザから表示終了要求が入力されたか否かを監視し、表示終了要求が入力されると処理を終了する。しかし、表示終了要求が入力されなければ、二次元コードの生成・表示処理を以下のように実行する。 (1-2) Setting the Display Color In step S12, the control unit 1 of the transmission device TX monitors whether or not a display end request has been input from the user, and ends the process when the display end request is input. However, if the display end request is not input, the two-dimensional code generation and display process is executed as follows.
　すなわち、送信装置ＴＸの制御部１は、先ず表示色設定処理部１２の制御の下、上記データ記憶部３１から分割情報を１つ読み込む。そして、一つ前に読み込んだ分割情報に対し設定した表示色が“Ａ”であるか“Ｂ”であるかをステップＳ１３により判定する。この判定の結果、一つ前の分割情報に設定した表示色が“Ｂ”であれば、ステップＳ１４において、今回読み込んだ分割情報の表示色を“Ａ”に設定する。これに対し、一つ前の分割情報に設定した表示色が“Ａ”であれば、ステップＳ１５において、今回読み込んだ分割情報の表示色を“Ｂ”に設定する。なお、初回に読み込んだ分割情報に対しては、デフォルト値として設定された例えば“Ａ”に設定する。この結果、例えばいま表示色“Ａ”を“赤（Ｒ）”、表示色“Ｂ”を“青（Ｂ）”とすれば、各分割情報には読み込み順に交互に“赤（Ｒ）”，“青（Ｂ）”，“赤（Ｒ）”，…が設定される。 That is, the control unit 1 of the transmission device TX first reads one piece of division information from the data storage unit 31 under the control of the display color setting processing unit 12. Then, in step S13, it is determined whether the display color set for the division information read one time before is "A" or "B". If the result of this determination is that the display color set for the division information one time before is "B", in step S14, the display color of the division information read this time is set to "A". On the other hand, if the display color set for the division information one time before is "A", in step S15, the display color of the division information read this time is set to "B". Note that for the division information read for the first time, the display color is set to, for example, "A" which is set as a default value. As a result, if the display color "A" is now "red (R)" and the display color "B" is "blue (B)", the division information is set to "red (R)", "blue (B)", "red (R)", ... alternately in the order in which it is read.
　（１－３）二次元コードの生成とその表示
　送信装置ＴＸの制御部１は、続いて二次元コード生成処理部１３の制御の下、ステップＳ１６において、上記表示色設定処理部１２により表示色が設定された分割情報を、当該分割情報の内容を表しかつ上記表示色が反映された二次元コードに変換する。 (1-3) Generation of a two-dimensional code and its display Next, in step S16, under the control of the two-dimensional code generation processing unit 13, the control unit 1 of the transmitting device TX converts the divided information, whose display color has been set by the display color setting processing unit 12, into a two-dimensional code that represents the content of the divided information and reflects the display color.
　そして、送信装置ＴＸの制御部１は、ステップＳ１７において、二次元コード表示制御処理部１４の制御の下、上記二次元コード生成処理部１３により生成された二次元コードを、入出力Ｉ／Ｆ部４を介して表示デバイス７へ出力し表示する。 Then, in step S17, the control unit 1 of the transmission device TX, under the control of the two-dimensional code display control processing unit 14, outputs the two-dimensional code generated by the two-dimensional code generation processing unit 13 to the display device 7 via the input/output I/F unit 4 and displays it.
　送信装置ＴＸの制御部１は、上記１個の分割情報に対する二次元コードが生成・表示されるごとに、ステップＳ１８においてｔ秒待機し、しかるのちステップＳ１２に戻って、次の分割情報に対する二次元コードの生成・表示処理を行う。 The control unit 1 of the transmitting device TX waits for t seconds in step S18 each time a two-dimensional code for one piece of divided information is generated and displayed, and then returns to step S12 to generate and display a two-dimensional code for the next piece of divided information.
　この結果、送信装置ＴＸの表示デバイス７には、上記ｔ秒の間隔で分割情報に対する二次元コードがあたかも動画像のように順次表示される。図８は、その表示結果の一例を示すもので、この例では各分割情報の二次元コードが“赤”，“青”，“赤”，…の順に交互に表示される場合を示している。 As a result, the two-dimensional codes for the divided information are displayed in sequence, like a moving image, at intervals of t seconds on the display device 7 of the transmitting device TX. Figure 8 shows an example of the display result, in which the two-dimensional codes for each divided information are displayed alternately in the order "red", "blue", "red", ....
　（２）受信装置ＲＸの動作
　図７は、受信装置ＲＸの制御部１０が実行する二次元コード再生処理の処理手順と処理内容の一例を示すフローチャートである。 (2) Operation of the Receiving Device RX FIG. 7 is a flowchart showing an example of the procedure and contents of a two-dimensional code reproduction process executed by the control unit 10 of the receiving device RX.
　（２－１）カメラ画像の取得および二次元コードの識別
　受信装置ＲＸの制御部１０は、先ずステップＳ１０において、ユーザによる二次元コード読み取り操作を監視する。そして、読み取り操作を検出すると、カメラ画像取得処理部１０１の制御の下、カメラ８０を起動して、送信装置ＴＸの表示デバイス７に表示される二次元コードの読み取り処理を開始する。 (2-1) Acquisition of camera image and identification of two-dimensional code First, in step S10, the control unit 10 of the receiving device RX monitors the user's operation to read the two-dimensional code. Then, when the control unit 10 detects the reading operation, it starts the camera 80 under the control of the camera image acquisition processing unit 101, and starts the reading process of the two-dimensional code displayed on the display device 7 of the transmitting device TX.
　上記読み取り処理において受信装置ＲＸの制御部１０は、ステップＳ２１により、カメラ８０により撮像された上記二次元コードの動画像データを入出力Ｉ／Ｆ部４０を介して順次取り込み、カメラ画像記憶部３０１に記憶する。 In the above reading process, in step S21, the control unit 10 of the receiving device RX sequentially imports video image data of the above two-dimensional code captured by the camera 80 via the input/output I/F unit 40 and stores it in the camera image storage unit 301.
　受信装置ＲＸの制御部１０は、次に二次元コード識別処理部１０２の制御の下、上記カメラ画像記憶部３０１から上記二次元コードの動画像データをフレームごとに読み込む。そして、読み込んだ各フレーム画像をステップＳ２２によりそれぞれ二値化し、ステップＳ２３において二次元コード画像を得る。 The control unit 10 of the receiving device RX then reads the video data of the two-dimensional code from the camera image storage unit 301 frame by frame under the control of the two-dimensional code identification processing unit 102. Then, each frame image that has been read is binarized in step S22, and a two-dimensional code image is obtained in step S23.
　また、二次元コード識別処理部１０２は、上記各二次元コード画像からそれぞれ二次元コードの特定パターンを検知する。例えば、二次元コードがＱＲコード（登録商標）であれば、そのファインダパターンを検知する。そして、ファインダパターンを検知できたか否かをステップＳ２４により判定し、検知されなければステップＳ２０を経てステップＳ２１に戻り、上記ステップＳ２１～Ｓ２４によるカメラ画像の取得および二次元コードの識別処理を繰り返す。 The two-dimensional code identification processing unit 102 also detects a specific pattern of the two-dimensional code from each of the two-dimensional code images. For example, if the two-dimensional code is a QR code (registered trademark), it detects its finder pattern. Then, in step S24, it determines whether or not the finder pattern has been detected, and if not, it returns to step S21 via step S20, and repeats the acquisition of the camera image and the two-dimensional code identification process in steps S21 to S24.
　（２－２）色別フィルタリング
　一方、上記ファインダパターンが検知されると受信装置ＲＸの制御部１０は、次にステップＳ２５において、色別フィルタリング処理部１０３の制御の下、各二次元コード画像に対する色別フィルタリング処理を以下のように実行する。 (2-2) Color Filtering On the other hand, when the finder pattern is detected, the control unit 10 of the receiving device RX then, in step S25, executes color filtering processing for each two-dimensional code image under the control of the color filtering processing unit 103 as follows.
　すなわち、色別フィルタリング処理部１０３は、送信装置ＴＸが表示色の設定に使用したＲＧＢ要素のうちの２色（この例では“赤”と“青”）を分離対象とする色別フィルタリング処理を行い、これにより上記各二次元コード画像をそれぞれ“赤”の色成分のみを持つ二次元コード画像と、“青”の色成分のみを持つ二次元コード画像とに分離する。 In other words, the color-specific filtering processing unit 103 performs color-specific filtering processing to separate two colors (in this example, "red" and "blue") from the RGB elements used by the transmitting device TX to set the display color, thereby separating each of the two-dimensional code images into a two-dimensional code image having only the "red" color component and a two-dimensional code image having only the "blue" color component.
　なお、色別フィルタリングの具体的な手法としては、以下の手法が用いられてもよい。すなわち、表示色を表す情報を（ｒ＝赤，ｇ＝緑，ｂ＝青）と定義し、かつ輝度情報を０～ｍａｘとすると、ＲＧＢ特性が（ｒ，max，max）、（max，max，ｂ）となる２個の二次元コード画像を、上記二次元コード画像から分離する。 The specific method for color filtering may be the following. That is, if the information representing the display color is defined as (r=red, g=green, b=blue) and the brightness information is 0 to max, two 2D code images with RGB characteristics of (r, max, max) and (max, max, b) are separated from the 2D code image.
　この結果、カメラ８０により読み取られた分離前の二次元コード画像に１フレーム前の二次元コード画像の一部が混在していたとしても、上記色別フィルタリング処理により、各フレームの二次元コード画像をそれぞれ現フレームの二次元コード画像と１フレーム前の二次元コード画像とに分離することが可能となる。 As a result, even if the two-dimensional code image before separation read by the camera 80 contains part of the two-dimensional code image from one frame before, the above-mentioned color filtering process makes it possible to separate the two-dimensional code image of each frame into the two-dimensional code image of the current frame and the two-dimensional code image from one frame before.
　（２－３）二次元コード画像の有効／無効判定と無効コードの棄却
　受信装置ＲＸの制御部１０は、続いて無効コード棄却処理部１０４の制御の下、上記色別フィルタリング処理部１０３により分離された、表示色の異なる２個の二次元コード画像のうちから、有効な二次元コード画像を選択し、無効な二次元コード画像を棄却する処理を以下のように実行する。 (2-3) Determining whether a two-dimensional code image is valid or invalid and discarding invalid codes The control unit 10 of the receiving device RX then, under the control of the invalid code rejection processing unit 104, selects a valid two-dimensional code image from the two two-dimensional code images with different display colors separated by the color-specific filtering processing unit 103, and discards the invalid two-dimensional code image, as follows.
　すなわち、無効コード棄却処理部１０４は、先ずステップＳ２６において、上記２色の二次元コード画像をそれぞれグレースケールの画像に変換する。続いて無効コード棄却処理部１０４は、ステップＳ２７において、グレースケール化された上記２個の二次元コード画像の画素濃度を検出し、検出した画素濃度をもとに上記２個の二次元コード画像が有効か無効かを判定する。そして、有効と判定された二次元コード画像を選択し、無効と判定された二次元コード画像を棄却する。 In other words, the invalid code rejection processing unit 104 first converts the two-color two-dimensional code images into grayscale images in step S26. Next, in step S27, the invalid code rejection processing unit 104 detects the pixel density of the two grayscaled two-dimensional code images, and determines whether the two two-dimensional code images are valid or invalid based on the detected pixel density. Then, it selects the two-dimensional code images that are determined to be valid, and rejects the two-dimensional code images that are determined to be invalid.
　具体的には、例えば各二次元コード画像からファインダパターンを検出し、検出した上記ファインダパターンの画素の輝度を検出する。そして、上記２個の二次元コード画像間で、上記ファインダパターンの輝度を比較し、その比較の結果、輝度の高い側、つまり濃度が低い側の二次元コード画像を無効と判定して棄却する。これに対し、輝度の低い側、つまり濃度が高い側の二次元コード画像を有効と判定して選択する。 Specifically, for example, a finder pattern is detected from each two-dimensional code image, and the brightness of the pixels of the detected finder pattern is detected. The brightness of the finder patterns is then compared between the two two-dimensional code images, and as a result of this comparison, the two-dimensional code image with the higher brightness, i.e., the lower density, is determined to be invalid and discarded. In contrast, the two-dimensional code image with the lower brightness, i.e., the higher density, is determined to be valid and selected.
　図９は、この二次元コード画像の有効／無効判定手法の一例を説明するものである。同図において、Ｖｂｒは色別に分離する前の二次元コード画像、Ｖｂ，Ｖｒはそれぞれ分離後の“青”色の二次元コード画像、“赤”色の二次元コード画像を示している。この例では、“青”色の二次元コード画像Ｖｂと“赤”色の二次元コード画像Ｖｒとの間で、それぞれのファインダパターンの輝度の合計値（ｂ１＋ｂ２＋ｂ３）と（ｒ１＋ｒ２＋ｒ３）とを比較し、輝度の合計値が高い“青”色の二次元コード画像Ｖｂを無効コードとして棄却し、輝度の合計値が低い“赤”色の二次元コード画像Ｖｒを有効コードとして選択する。 Figure 9 explains an example of a method for determining whether a two-dimensional code image is valid or invalid. In the figure, Vbr indicates the two-dimensional code image before it is separated by color, while Vb and Vr indicate the "blue" and "red" two-dimensional code images after separation, respectively. In this example, the total brightness values (b1+b2+b3) and (r1+r2+r3) of the respective finder patterns of the "blue" two-dimensional code image Vb and the "red" two-dimensional code image Vr are compared, and the "blue" two-dimensional code image Vb, which has a higher total brightness value, is rejected as an invalid code, and the "red" two-dimensional code image Vr, which has a lower total brightness value, is selected as a valid code.
　（２－４）ローリングシャッタ対策を講じた二値化処理
　二値化コード画像は、カメラの走査方式により発生するローリングシャッタ現象の影響を受け、水平方向または垂直方向に画素の輝度（濃度）が線形に変化していることがある。そのため、二値化コード画像を固定された１個のしきい値で二値化すると、二次元コードの認識精度が低下してしまう。 (2-4) Binarization process with rolling shutter countermeasures Binary code images are affected by the rolling shutter phenomenon that occurs due to the camera's scanning method, and the brightness (density) of pixels may change linearly in the horizontal or vertical direction. Therefore, if a binary code image is binarized with a single fixed threshold value, the recognition accuracy of the two-dimensional code will decrease.
　そこで、受信装置ＲＸの制御部１０は、ローリングシャッタ対策二値化処理部１０５の制御の下で、以下のようなローリングシャッタ対策を講じた二値化処理を実行する。 The control unit 10 of the receiving device RX executes binarization processing that takes measures against rolling shutter as follows, under the control of the rolling shutter countermeasure binarization processing unit 105.
　すなわち、ローリングシャッタ対策二値化処理部１０５は、ステップＳ２８においてアフィン変換を行ったのち、ステップＳ２９において、二値化対象の二次元コード画像に対し、その水平方向または垂直方向（列方向または行方向ともいう）の各々について、二値化しきい値を設定する。 In other words, the rolling shutter countermeasure binarization processing unit 105 performs affine transformation in step S28, and then in step S29, sets a binarization threshold value for each of the horizontal and vertical directions (also called the column direction or row direction) of the two-dimensional code image to be binarized.
　具体的には、ローリングシャッタ対策二値化処理部１０５は、例えば図１０に示すように、先ずファインダパターンの基準点の画素の輝度ｃ１，ｃ２，ｃ３を検出する。そして、ローリングシャッタ対策二値化処理部１０５は、水平方向ｘにおけるファインダパターン間の輝度ｃ１，ｃ３の差（ｃ３－ｃ１）と、垂直方向ｙにおけるファインダパターン間の輝度ｃ２，ｃ１の差（ｃ２－ｃ１）とを比較する。 Specifically, the rolling shutter countermeasure binarization processing unit 105 first detects the brightness c1, c2, and c3 of the pixels at the reference points of the finder patterns, for example as shown in FIG. 10. The rolling shutter countermeasure binarization processing unit 105 then compares the difference in brightness c1, c3 between the finder patterns in the horizontal direction x (c3-c1) with the difference in brightness c2, c1 between the finder patterns in the vertical direction y (c2-c1).
　続いてローリングシャッタ対策二値化処理部１０５は、上記比較結果が｜ｃ２－ｃ１｜＞｜ｃ３－ｃ１｜であれば、水平方向ｘにおけるしきい値Ｔｘを
　　　　Ｔｘ＝（ｃ２－ｃ１）／Ｎ－７（ｘ－４）＋ｃ１
として算出する。 Next, if the comparison result is |c2-c1|>|c3-c1|, the rolling shutter countermeasure binarization processing unit 105 calculates the threshold value Tx in the horizontal direction x as follows: Tx=(c2-c1)/N-7(x-4)+c1
It is calculated as follows.
　一方、上記比較結果が、｜ｃ２－ｃ１｜＜｜ｃ３－ｃ１｜であれば、垂直方向ｙにおけるしきい値Ｔｙを
　　　　Ｔｙ＝（ｃ３－ｃ１）／Ｎ－７（ｙ－４）＋ｃ１
として算出する。 On the other hand, if the comparison result is |c2-c1|<|c3-c1|, the threshold value Ty in the vertical direction y is set as follows: Ty=(c3-c1)/N-7(y-4)+c1
It is calculated as follows.
　ここで、上記Ｎ－７，ｘ－４，ｙ－４における“７”，“４”は、変数ではなく、定数（数値）である。すなわち、Ｎ－７はファインダパターンの基準点ｃ２（あるいは基準点ｃ３）から基準点ｃ１までのピクセル数を表しており、それぞれ基準点が二次元コードの外枠より４ピクセル目に位置していることを示す。また、ｘ－４，ｙ－４は、基準点ｃ１の水平方向ｘまたは垂直方向ｙの位置が４ピクセル目であることを示している。そして、上記各式では、基準点ｃ１とｃ２、ｃ１とｃ３との間の位置を基準として、その濃度をしきい値Ｔｘ，Ｔｙとして算出している。 Here, the "7" and "4" in N-7, x-4, and y-4 above are not variables but constants (numeric values). That is, N-7 represents the number of pixels from reference point c2 (or reference point c3) of the finder pattern to reference point c1, and indicates that each reference point is located 4 pixels from the outer frame of the 2D code. Also, x-4 and y-4 indicate that the position of reference point c1 in the horizontal direction x or vertical direction y is 4 pixels. In the above formulas, the positions between reference points c1 and c2, and c1 and c3 are used as references, and the densities are calculated as threshold values Tx and Ty.
　ローリングシャッタ対策二値化処理部１０５は、以上のように算出されたしきい値Ｔｘ，Ｔｙを用いて、二値化対象の二次元コード画像を二値化し、二次元コードデータを再生する。 The rolling shutter countermeasure binarization processing unit 105 uses the thresholds Tx and Ty calculated as described above to binarize the two-dimensional code image to be binarized and reproduce the two-dimensional code data.
　（２－５）二次元コードのデコード
　受信装置ＲＸの制御部１０は、デコード処理部１０６の制御の下、ステップＳ３０において、上記ローリングシャッタ対策二値化処理部１０５から二値化された二次元コードデータを受け取り、受け取った二次元コードデータをデコードして分割情報を再生する。そして、再生した分割情報を再生情報記憶部３０２に一時保存する。 (2-5) Decoding of 2D Code In step S30, the control unit 10 of the receiving device RX receives the binarized 2D code data from the rolling shutter countermeasure binarization processing unit 105 under the control of the decoding processing unit 106, decodes the received 2D code data, and reproduces the division information. Then, the reproduced division information is temporarily stored in the reproduction information storage unit 302.
　上記１個の二次元コード画像のデコード処理を終了すると、受信装置ＲＸの制御部１０は、ステップＳ２０を経てステップＳ２１に戻り、ステップＳ２１～Ｓ３０による一連の二次元コード再生処理を再度実行する。以後、全フレームの二次元コード画像に対する再生処理が終了するまで、受信装置ＲＸの制御部１０は上記ステップＳ２１～Ｓ３０による処理を繰り返し実行する。 When the decoding process for one two-dimensional code image is completed, the control unit 10 of the receiving device RX returns to step S21 via step S20, and executes the series of two-dimensional code reproduction processes from steps S21 to S30 again. After this, the control unit 10 of the receiving device RX repeatedly executes the processes from steps S21 to S30 until the reproduction process for all frames of the two-dimensional code image is completed.
　一方、受信装置ＲＸの制御部１０は、ステップＳ２０において二次元コードの読み取り終了を判定すると、ステップＳ３１において、デコード処理部１０６により上記再生情報記憶部３０２に保存されている各分割情報を結合し、分割前の転送対象情報を再生する。そして、再生した上記転送対象情報を再生情報記憶部３０２に記憶する。 On the other hand, when the control unit 10 of the receiving device RX determines in step S20 that the reading of the two-dimensional code has been completed, in step S31, the decoding processing unit 106 combines the divided information stored in the playback information storage unit 302 to reproduce the information to be transferred before it was divided. Then, the reproduced information to be transferred is stored in the playback information storage unit 302.
　再生した上記転送対象情報は、例えばユーザの表示操作に応じて上記再生情報記憶部３０２から読み出され、表示デバイス７０に表示される。 The reproduced information to be transferred is read from the reproduction information storage unit 302 in response to, for example, a user's display operation, and is displayed on the display device 70.
　（作用・効果）
　以上述べたように一実施形態では、送信装置ＴＸにおいて、転送対象情報を分割した複数の分割情報に対し交互に異なる２色の表示色を設定し、この異なる表示色が設定された各分割情報に対応する二次元コードを所定のフレームレートで動画像として表示デバイス７に表示する。一方、受信装置ＲＸでは、送信装置ＴＸの表示デバイス７に表示された上記二次元コードの画像をカメラ８０により読み取り、読み取った上記二次元コード画像を、先ず色別フィルタリング処理を行って上記２色の二次元コード画像に分離する。そして、分離された２色の二次元コード画像についてその画像濃度をもとに有効／無効を判定し、有効と判定した二次元コード画像を選択し、無効と判定した二次元コード画像を棄却する。次に、上記有効と判定した二次元コード画像について、ローリングシャッタ対策のための二値化しきい値を求め、当該二値化しきい値を用いて上記二次元コード画像を二値化して二次元コードデータを再生する。そして、再生した上記二次元コードデータをデコードして分割情報を再生し、最後に複数の分割情報を結合して元の転送対象情報を再生する。 (Action and Effects)
As described above, in one embodiment, the transmission device TX sets two display colors that are alternately different for a plurality of divided information pieces obtained by dividing the information to be transferred, and displays the two-dimensional code corresponding to each divided information piece to which the different display colors are set on the display device 7 as a moving image at a predetermined frame rate. Meanwhile, the reception device RX reads the image of the two-dimensional code displayed on the display device 7 of the transmission device TX by the camera 80, and first performs color-specific filtering processing on the read two-dimensional code image to separate it into the two-dimensional code images of the two colors. Then, the separated two-dimensional code images of the two colors are judged to be valid/invalid based on their image density, and the two-dimensional code images judged to be valid are selected, and the two-dimensional code images judged to be invalid are rejected. Next, for the two-dimensional code images judged to be valid, a binarization threshold value for a rolling shutter countermeasure is obtained, and the two-dimensional code image is binarized using the binarization threshold value to reproduce the two-dimensional code data. Then, the reproduced two-dimensional code data is decoded to reproduce the divided information, and finally, the plurality of divided information pieces are combined to reproduce the original information to be transferred.
　従って、一実施形態によれば、二次元コードを動画像として表示したときの表示切替タイミングにおいて、読み取った二次元コード画像にその一つ前の二次元コード画像の一部が混在していても、前後の二次元コード画像が異なる表示色に設定されているため、この色の違いもとに前後の画像を分離することが可能となる。そして、分離された上記各二次元コード画像についてその画像濃度をもとに有効な二次元コード画像が選択され、選択された上記二次元コード画像をもとに二次元コードが再生される。従って、二次元コードの表示切替速度を速く設定しても、受信装置ＲＸでは高い認識率で二次元コードを再生することが可能となる。 Therefore, according to one embodiment, even if the read two-dimensional code image contains part of the previous two-dimensional code image at the display switching timing when the two-dimensional code is displayed as a moving image, the previous and next two-dimensional code images are set to different display colors, making it possible to separate the previous and next images based on this color difference. Then, for each of the separated two-dimensional code images, a valid two-dimensional code image is selected based on its image density, and the two-dimensional code is reproduced based on the selected two-dimensional code image. Therefore, even if the display switching speed of the two-dimensional code is set to be fast, the receiving device RX can reproduce the two-dimensional code with a high recognition rate.
　また、二次元コードをカメラ８０により撮像する際にローリングシャッタ現象が発生しても、二値化対象の二次元コード画像に対し水平方向または垂直方向の濃度特性に応じて最適な二値化しきい値が設定される。このため、上記ローリングシャッタ現象の影響は低減され、これにより二次元コード画像を高精度に二次元コードに変換することが可能となる。 In addition, even if the rolling shutter phenomenon occurs when the two-dimensional code is captured by the camera 80, an optimal binarization threshold is set for the two-dimensional code image to be binarized according to the horizontal or vertical density characteristics. This reduces the effects of the rolling shutter phenomenon, making it possible to convert the two-dimensional code image into a two-dimensional code with high accuracy.
　［その他の実施形態］
　送信装置および受信装置の種類や構成、送信装置が実行する転送対象情報を表す二次元コードの表示処理および受信装置が実行する二次元コード再生処理の処理手順と処理内容、転送対象情報の種類や構成、二次元コードの種類等についても、この発明の要旨を逸脱しない範囲で種々変形して実施可能である。 [Other embodiments]
The types and configurations of the transmitting device and receiving device, the processing procedures and contents of the display process of the two-dimensional code representing the information to be transferred performed by the transmitting device and the two-dimensional code reproduction process performed by the receiving device, the type and configuration of the information to be transferred, the type of two-dimensional code, etc. can be modified and implemented in various ways without departing from the spirit of this invention.
　以上、この発明の実施形態を詳細に説明してきたが、前述までの説明はあらゆる点においてこの発明の例示に過ぎない。この発明の範囲を逸脱することなく種々の改良や変形を行うことができることは言うまでもない。つまり、この発明の実施にあたって、実施形態に応じた具体的構成が適宜採用されてもよい。 Although the embodiments of the present invention have been described in detail above, the above description is merely an example of the present invention in every respect. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. In other words, when implementing the present invention, specific configurations according to the embodiments may be appropriately adopted.
　要するにこの発明は、上記実施形態そのままに限定されるものではなく、実施段階ではその要旨を逸脱しない範囲で構成要素を変形して具体化できる。また、上記実施形態に開示されている複数の構成要素の適宜な組み合せにより種々の発明を形成できる。例えば、実施形態に示される全構成要素から幾つかの構成要素を削除してもよい。さらに、異なる実施形態に亘る構成要素を適宜組み合せてもよい。 In short, this invention is not limited to the above-described embodiment as it is, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention. Furthermore, various inventions can be formed by appropriately combining multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined.
　ＴＸ…送信装置
　ＲＸ…受信装置
　１，１０…制御部
　２，２０…プログラム記憶部
　３，３０…データ記憶部
　４，４０…入出力Ｉ／Ｆ部
　５，５０…バス
　６，６０…入力デバイス
　７，７０…表示デバイス
　８０…カメラ
　１１…データ分割処理部
　１２…表示色設定処理部
　１３…二次元コード生成処理部
　１４…二次元コード表示制御処理部
　３１…データ記憶部
　１０１…カメラ画像取得処理部
　１０２…二次元コード識別処理部
　１０３…色別フィルタリング処理部
　１０４…無効コード棄却処理部
　１０５…ローリングシャッタ対策二値化処理部
　１０６…デコード処理部
　３０１…カメラ画像記憶部
　３０２…再生情報記憶部
  TX...Transmitting device RX...Receiving device 1, 10... Control unit 2, 20... Program storage unit 3, 30... Data storage unit 4, 40...Input/output I/ F unit 5, 50... Bus 6, 60... Input device 7, 70...Display device 80...Camera 11...Data division processing unit 12...Display color setting processing unit 13...Two-dimensional code generation processing unit 14...Two-dimensional code display control processing unit 31...Data storage unit 101...Camera image acquisition processing unit 102...Two-dimensional code identification processing unit 103...Color-based filtering processing unit 104...Invalid code rejection processing unit 105...Rolling shutter countermeasure binarization processing unit 106...Decoding processing unit 301...Camera image storage unit 302...Reproduction information storage unit

Claims (8)

  1. 　送信装置から受信装置へ、転送対象情報を二次元コードを用いて転送する情報転送システムであって、
    　前記送信装置は、
    　　前記転送対象情報を複数の分割情報に分割する第１の処理部と、
    　　前記分割情報のうち転送順序が隣り合う第１の分割情報および第２の分割情報に対し、それぞれ第１の表示色および第２の表示色を設定する第２の処理部と、
    　　前記第１の表示色が設定された前記第１の分割情報に対応する前記二次元コードと、前記第２の表示色が設定された前記第２の分割情報に対応する前記二次元コードとを、前記転送順序に従い予め設定された表示切替速度で表示デバイスに順次表示する第３の処理部と
    　を備え、
    　前記受信装置は、
    　　前記表示デバイスに順次表示された前記二次元コードの各々に対応する画像情報を撮像デバイスから取得する第４の処理部と、
    　　前記画像情報の各々に対し色分けのためのフィルタリング処理を行うことにより、前記画像情報の各々を、前記第１の表示色に対応する第１の画像情報と、前記第２の表示色に対応する第２の画像情報とに分離する第５の処理部と、
    　　分離された前記第１の画像情報および前記第２の画像情報についてその画像濃度をもとに有効性を判定し、前記第１の画像情報および前記第２の画像情報のうち有効と判定した有効画像情報を選択する第６の処理部と、
    　　前記画像情報の各々について得られた前記有効画像情報からそれぞれ前記二次元コードを認識する第７の処理部と、
    　　認識された前記二次元コードの各々をデコードして複数の前記分割情報を再生し、再生した複数の前記分割情報を結合して前記転送対象情報を再生する第８の処理部と
    　を備える
    　情報転送システム。     An information transfer system that transfers information to be transferred from a transmitting device to a receiving device using a two-dimensional code,
    The transmitting device includes:
    A first processing unit that divides the information to be transferred into a plurality of pieces of divided information;
    a second processing unit that sets a first display color and a second display color to first and second pieces of division information that are adjacent to each other in a transfer order among the pieces of division information;
    a third processing unit that sequentially displays, on a display device, the two-dimensional code corresponding to the first division information to which the first display color is set and the two-dimensional code corresponding to the second division information to which the second display color is set, at a preset display switching speed in accordance with the transfer order;
    The receiving device includes:
    a fourth processing unit that acquires, from an imaging device, image information corresponding to each of the two-dimensional codes sequentially displayed on the display device;
    a fifth processing unit that performs a filtering process for color-coding each of the image information to separate each of the image information into first image information corresponding to the first display color and second image information corresponding to the second display color;
    a sixth processing unit that determines validity of the separated first image information and the separated second image information based on image density thereof, and selects valid image information determined to be valid from the first image information and the second image information;
    a seventh processing unit that recognizes the two-dimensional code from the valid image information obtained for each of the image information;
    an eighth processing unit that decodes each of the recognized two-dimensional codes to reproduce the plurality of pieces of divided information, and combines the reproduced plurality of pieces of divided information to reproduce the information to be transferred.
  2. 　前記第７の処理部は、前記有効画像情報についてその水平方向または垂直方向における画素の濃度特性を検出し、検出した前記濃度特性に応じて前記水平方向または前記垂直方向に対し二値化閾値を設定し、設定した前記二値化閾値に従い前記有効画像情報から前記二次元コードに再生する、請求項１に記載の情報転送システム。 The information transfer system of claim 1, wherein the seventh processing unit detects the density characteristics of pixels in the horizontal or vertical direction of the effective image information, sets a binarization threshold for the horizontal or vertical direction according to the detected density characteristics, and reproduces the two-dimensional code from the effective image information according to the set binarization threshold.
  3. 　前記第２の処理部は、前記第１の表示色および前記第２の表示色として、ＲＧＢ要素のうちの２色を選択して用い、
    　前記第５の処理部は、前記画像情報の各々を、前記ＲＧＢ要素うちの選択された前記２色に対応する前記第１の画像情報と前記第２の画像情報とに分離する、
    　請求項１に記載の情報転送システム。     the second processing unit selects and uses two colors from among RGB elements as the first display color and the second display color;
    the fifth processing unit separates each of the image information into the first image information and the second image information corresponding to the two selected colors among the RGB components;
    The information transfer system according to claim 1 .
  4. 　前記第６の処理部は、分離された前記第１の画像情報および前記第２の画像情報の各々からファインダパターンを検出し、検出した前記ファインダパターンの画素濃度を前記第１の画像情報と前記第２の画像情報との間で比較し、前記第１の画像情報と前記第２の画像情報とのうち前記画素濃度が高い側を前記有効画像情報として選択する、請求項１に記載の情報転送システム。 The information transfer system of claim 1, wherein the sixth processing unit detects a finder pattern from each of the separated first image information and the second image information, compares the pixel density of the detected finder pattern between the first image information and the second image information, and selects the first image information or the second image information that has the higher pixel density as the valid image information.
  5. 　送信装置から受信装置へ、転送対象情報を二次元コードを用いて転送する情報転送システムで使用される前記送信装置であって、
    　前記転送対象情報を複数の分割情報に分割する第１の処理部と、
    　前記分割情報のうち転送順序が隣り合う第１の分割情報および第２の分割情報に対し、それぞれ第１の表示色および第２の表示色を設定する第２の処理部と、
    　前記第１の表示色が設定された前記第１の分割情報に対応する前記二次元コードと、前記第２の表示色が設定された前記第２の分割情報に対応する前記二次元コードとを、前記転送順序に従い予め設定された表示切替速度で表示デバイスに順次表示する第３の処理部と
    　を備える送信装置。     A transmitting device used in an information transfer system that transfers information to be transferred from a transmitting device to a receiving device using a two-dimensional code,
    A first processing unit that divides the information to be transferred into a plurality of pieces of divided information;
    a second processing unit that sets a first display color and a second display color to first and second pieces of division information that are adjacent to each other in a transfer order among the pieces of division information;
    a third processing unit that sequentially displays the two-dimensional code corresponding to the first division information to which the first display color is set and the two-dimensional code corresponding to the second division information to which the second display color is set on a display device at a predetermined display switching speed in accordance with the transfer order.
  6. 　請求項５記載の送信装置に表示される前記二次元コードを読み取って前記転送対象情報を再生する受信装置であって、
    　前記表示デバイスに順次表示された前記二次元コードの各々に対応する画像情報を撮像デバイスから取得する第４の処理部と、
    　前記画像情報の各々に対し色分けのためのフィルタリング処理を行うことにより、前記画像情報の各々を、前記第１の表示色に対応する第１の画像情報と、前記第２の表示色に対応する第２の画像情報とに分離する第５の処理部と、
    　分離された前記第１の画像情報および前記第２の画像情報についてその画像濃度をもとに有効性を判定し、前記第１の画像情報および前記第２の画像情報のうち有効と判定した有効画像情報を選択する第６の処理部と、
    　前記画像情報の各々について得られた前記有効画像情報からそれぞれ前記二次元コードを認識する第７の処理部と、
    　認識された前記画像情報の各々について得られた前記有効画像情報からそれぞれ前記二次元コードを認識する第７の処理部と、
    　認識された前記二次元コードの各々をデコードして複数の前記分割情報を再生し、再生した複数の前記分割情報を結合して前記転送対象情報を再生する第８の処理部と
    　を備える受信装置。     A receiving device that reads the two-dimensional code displayed on the transmitting device according to claim 5 and reproduces the information to be transferred,
    a fourth processing unit that acquires, from an imaging device, image information corresponding to each of the two-dimensional codes sequentially displayed on the display device;
    a fifth processing unit that performs a filtering process for color-coding each of the image information to separate each of the image information into first image information corresponding to the first display color and second image information corresponding to the second display color;
    a sixth processing unit that determines validity of the separated first image information and the separated second image information based on image density thereof, and selects valid image information determined to be valid from the first image information and the second image information;
    a seventh processing unit that recognizes the two-dimensional code from the valid image information obtained for each of the image information;
    a seventh processing unit that recognizes the two-dimensional code from the valid image information obtained for each of the recognized image information;
    an eighth processing unit that decodes each of the recognized two-dimensional codes to reproduce the plurality of pieces of divided information, and combines the reproduced plurality of pieces of divided information to reproduce the information to be transferred.
  7. 　送信装置から受信装置へ、転送対象情報を二次元コードを用いて転送するシステムにより実行される情報転送方法であって、
    　前記送信装置が、前記転送対象情報を複数の分割情報に分割する過程と、
    　前記送信装置が、前記分割情報のうち転送順序が隣り合う第１の分割情報および第２の分割情報に対し、それぞれ第１の表示色および第２の表示色を設定する過程と、
    　前記送信装置が、前記第１の表示色が設定された前記第１の分割情報に対応する前記二次元コードと、前記第２の表示色が設定された前記第２の分割情報に対応する前記二次元コードとを、前記転送順序に従い予め設定された表示切替速度で表示デバイスに順次表示する過程と、
    　前記受信装置が、前記表示デバイスに順次表示された前記二次元コードの各々に対応する画像情報を撮像デバイスから取得する過程と、
    　前記受信装置が、前記画像情報の各々に対し色分けのためのフィルタリング処理を行うことにより、前記画像情報の各々を、前記第１の表示色に対応する第１の画像情報と、前記第２の表示色に対応する第２の画像情報とに分離する過程と、
    　前記受信装置が、分離された前記第１の画像情報および前記第２の画像情報についてその画像濃度をもとに有効性を判定し、前記第１の画像情報および前記第２の画像情報のうち有効と判定した有効画像情報を選択する過程と、
    　前記受信装置が、前記画像情報の各々について得られた前記有効画像情報からそれぞれ前記二次元コードを認識する第７の処理部と、
    　前記受信装置が、認識された前記二次元コードの各々をデコードして複数の前記分割情報を再生し、再生した複数の前記分割情報を結合して前記転送対象情報を再生する過程と
    　を備える情報転送方法。     An information transfer method executed by a system that transfers information to be transferred from a transmitting device to a receiving device using a two-dimensional code, comprising:
    A step of dividing the information to be transferred into a plurality of pieces of divided information by the transmitting device;
    a step of setting a first display color and a second display color, respectively, for first division information and second division information adjacent to each other in a transfer order among the division information, by the transmitting device;
    a step of the transmitting device sequentially displaying the two-dimensional code corresponding to the first division information to which the first display color is set and the two-dimensional code corresponding to the second division information to which the second display color is set on a display device at a preset display switching speed in accordance with the transfer order;
    a step of the receiving device acquiring image information corresponding to each of the two-dimensional codes displayed sequentially on the display device from an imaging device;
    a step in which the receiving device performs a filtering process for color-coding each of the image information, thereby separating each of the image information into first image information corresponding to the first display color and second image information corresponding to the second display color;
    a step in which the receiving device determines validity of the separated first image information and the separated second image information based on image density, and selects valid image information determined to be valid from the first image information and the second image information;
    a seventh processing unit configured to recognize the two-dimensional code from the valid image information obtained for each of the image information by the receiving device;
    and a step in which the receiving device decodes each of the recognized two-dimensional codes to reproduce a plurality of the divided information pieces, and combines the reproduced plurality of the divided information pieces to reproduce the information to be transferred.
  8. 　請求項６に記載の受信装置が備える第４乃至第８の処理部が行う処理の少なくともと１つを、前記受信装置が備えるプロセッサに実行させるプログラム。 A program that causes a processor provided in the receiving device to execute at least one of the processes performed by the fourth to eighth processing units provided in the receiving device described in claim 6.
PCT/JP2022/044879 2022-12-06 2022-12-06 Information transfer system, transmission device, receiving device, information transfer method and program WO2024121928A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/044879 WO2024121928A1 (en) 2022-12-06 2022-12-06 Information transfer system, transmission device, receiving device, information transfer method and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/044879 WO2024121928A1 (en) 2022-12-06 2022-12-06 Information transfer system, transmission device, receiving device, information transfer method and program

Publications (1)

Publication Number Publication Date
WO2024121928A1 true WO2024121928A1 (en) 2024-06-13

Family

ID=91378775

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/044879 WO2024121928A1 (en) 2022-12-06 2022-12-06 Information transfer system, transmission device, receiving device, information transfer method and program

Country Status (1)

Country Link
WO (1) WO2024121928A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06259588A (en) * 1993-03-05 1994-09-16 Tokyo Electric Co Ltd Bar code reader
JP2006139349A (en) * 2004-11-10 2006-06-01 Nikon Corp Information transmission apparatus, information reception apparatus, and information sending apparatus
JP2006252039A (en) * 2005-03-09 2006-09-21 Casio Comput Co Ltd Code reader, code-reading method and program
US20110000958A1 (en) * 2009-07-02 2011-01-06 John Herzig Systems and Methods for Animating Barcodes

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06259588A (en) * 1993-03-05 1994-09-16 Tokyo Electric Co Ltd Bar code reader
JP2006139349A (en) * 2004-11-10 2006-06-01 Nikon Corp Information transmission apparatus, information reception apparatus, and information sending apparatus
JP2006252039A (en) * 2005-03-09 2006-09-21 Casio Comput Co Ltd Code reader, code-reading method and program
US20110000958A1 (en) * 2009-07-02 2011-01-06 John Herzig Systems and Methods for Animating Barcodes

Similar Documents

Publication Publication Date Title
US7889974B2 (en) Method and apparatus for editing images, and method and apparatus for reproducing the edited images
US8811471B2 (en) Moving picture decoding method, moving picture decoding program, moving picture decoding apparatus, moving picture encoding method, moving picture encoding program, and moving picture encoding apparatus
RU2573257C2 (en) Image signal decoding device, image signal decoding method, image signal encoding device, image signal encoding method and programme
US20110026591A1 (en) System and method of compressing video content
KR101471830B1 (en) Data transmission using out-of-gamut color coordinates
KR102666666B1 (en) Apparatus for encoing image and apparatus for decoding image
CA2779066C (en) Moving image processing program, moving image processing device, moving image processing method, and image-capturing device provided with moving image processing device
WO2010004711A1 (en) Image processing apparatus and image pickup apparatus using the image processing apparatus
US10616502B2 (en) Camera preview
US20220264091A1 (en) Information compression/decompression methods and apparatuses, and storage medium
CN105681791A (en) Self-adaptive remote desktop transmission method and system
US7974435B2 (en) Pattern-based encoding and detection
US10250900B2 (en) Systems and methods for embedding metadata into video contents
US10009544B2 (en) Image capturing apparatus, control method of the same and image sensor
US9361500B2 (en) Image processing apparatus, image processing method, and recording medium
WO2024121928A1 (en) Information transfer system, transmission device, receiving device, information transfer method and program
JPWO2004056084A1 (en) Image data compression apparatus and restoration apparatus, and image data compression program and restoration program
NL1034461C2 (en) Method and device for sending / receiving data.
US11425301B2 (en) Image processing apparatus, information processing apparatus, image processing method, and information processing method
US20170318300A1 (en) Image processing apparatus and control method thereof
CN114640882A (en) Video processing method and device, electronic equipment and computer readable storage medium
CN115474061B (en) Image data transmission method, device, terminal equipment and storage medium
TWI835236B (en) Image processing method and image processing device
US20240112449A1 (en) Image identifying apparatus, video reproducing apparatus, image identifying method, and recording medium
JP2012119798A (en) Image generation method, image generation device and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22967781

Country of ref document: EP

Kind code of ref document: A1