WO2023003589A1

WO2023003589A1 - Determining whether image includes sensitive information

Info

Publication number: WO2023003589A1
Application number: PCT/US2021/065447
Authority: WO
Inventors: Seunghun Park; Eulhwan LEE; Byoungjun SUNG
Original assignee: Hewlett-Packard Development Company, L.P.
Priority date: 2021-07-23
Filing date: 2021-12-29
Publication date: 2023-01-26
Also published as: KR20230015676A

Abstract

An example electronic apparatus includes an automatic document feeder to supply printing medium and including a front image sensor and a rear image sensor to detect a front image and a rear image of the supplied printing medium, respectively and a processor. The processor is to receive front image data and rear image data from the front image sensor and the rear image sensor, change the front image data and the rear image data to a reference resolution through separate resolution conversion blocks, and detects whether sensitive information is included in the front image and the rear image by dividing front image data and rear image data changed to a reference resolution into band images by using a detection block to alternately process front and rear band images.

Description

DETERMINING WHETHER IMAGE INCLUDES SENSITIVE INFORMATION

BACKGROUND

[0001] An image forming apparatus may include an apparatus to print print data generated by a terminal device, such as a computer, on a printing medium such as paper. Examples of the image forming apparatus may include a copier, a printer, a facsimile, a scanner, or a multi-function peripheral (MFP) device that combines functions thereof through a single apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

[0002] Various examples will be described below by referring to the following figures.

[0003] FIG. 1 is a diagram illustrating a system according to an example;

[0004] FIG. 2 is a block diagram illustrating an electronic apparatus according to an example;

[0005] FIG. 3 is a block diagram illustrating an electronic apparatus according to an example;

[0006] FIG. 4 is a diagram illustrating an automatic document feeder according to an example;

[0007] FIG. 5 is a diagram illustrating a gap between printing medium according to an example;

[0008] FIG. 6 is a diagram illustrating page control according to an example;

[0009] FIG. 7 is a diagram illustrating a banknote according to an example;

[0010] FIG. 8 is a diagram illustrating a process of detecting a banknote according to an example;

[0011] FIG. 9 is a flowchart illustrating a process of detecting a banknote according to an example;

[0012] FIG. 10 is a diagram illustrating a process for processing a band according to an example; l [0013] FIG. 11 is a diagram illustrating a process performed in parallel of detecting whether sensitive information is included according to an example; [0014] FIGS. 12A to 12C are diagrams illustrating a result of detecting whether sensitive information is included according to an example;

[0015] FIG. 13 is a flow diagram illustrating a process of detecting whether sensitive information is included according to an example;

[0016] FIG. 14 is a diagram illustrating a process for detecting a code according to an example;

[0017] FIG. 15 is a diagram illustrating a process of detecting whether a code is authentic according to an example;

[0018] FIG. 16 is a flow diagram illustrating a process of detecting whether a code is authentic according to an example;

[0019] FIG. 17 is a flowchart illustrating a process of detecting authenticity according to an example; and

[0020] FIG. 18 is a diagram illustrating instructions stored in a non- transitory computer-readable recording medium according to an example.

DETAILED DESCRIPTION

[0021] hereinafter, various examples will be described with reference to the drawings. The examples described below may be modified and implemented in various different forms.

[0022] In the present disclosure, an element that is referred to as being “connected” with another element may include a case of being directly connected and also a case of being connected indirectly, for example with another element therebetween. Also, an element that is described as “including” another element may indicate that the element may not exclude another element and may further include additional elements, unless specifically stated otherwise. Each example may be implemented or operated independently, or each example may be implemented or operated in combination.

[0023] In the present disclosure, the term “image forming job” may refer to any of various jobs (e.g., copying, printing, scanning or faxing) related to an image, such as forming the image or generating/storing/transmitting an image file, and the term “job” may refer to the image forming job in some examples, and may also refer to a series of processes for performing the image forming job in other examples.

[0024] The term “print data” may refer to data converted into a printable format by the printer. Based on the printer supporting direct printing, the file itself may be print data.

[0025] The term “image forming apparatus” may refer to an apparatus that prints print data generated by a terminal apparatus such as a computer on a recording medium such as paper. Examples of such an image forming apparatus include a copier, a printer, a facsimile, a scanner, a multi-function peripheral (MFP) that combines functions thereof through a single apparatus, or the like. [0026] An "external device" may refer to a device to provide information or a service to an image forming apparatus through a network. For example, the external device may be a server, a cloud, an artificial intelligence (Al) cloud (e.g., an Al server), a web server, a host device, a user terminal device, and the like. Based on the external device being a server, the server may include, for example, a payment server, a management server, and the like. The service may be provided in one physical server and may be provided in a virtual server (e.g., a cloud server) which divides one physical server. Various examples may include a plurality of external devices. For example, one external device may be a general server for performing an operation for error processing of an image forming apparatus, and another external device may be an artificial intelligence (Al) cloud (or an Al server) for learning an error and a solution and generating a trained error resolution model.

[0027] The expression “user” as used herein may refer to a person who may perform a manipulation related with an image forming job using the image forming apparatus or a device connected to the image forming apparatus in a wired or wireless manner. Further, the expression “manager” as used herein may refer to a person who has an authority to access all the functions and systems of the image forming apparatus. The “manager” and the “user” may refer to the same person.

[0028] The expression “sensitive information” may refer to information on whether the information is a banknote, a gift certificate/barcode/quick response (QR) code, a valid banknote, a valid gift certificate/barcode/QR code, or the like. [0029] Various examples as described below are to detect whether a target image (e.g., a set image) such as a banknote, or the like, is included in a printing medium. Various examples as described below are to detect whether there is sensitive information on a front of the target image or a rear of the target image. Various examples of the disclosure relate to an electronic apparatus to detect whether a target image such as a barcode or a QR code is included in a printing medium, search for product information corresponding to information of the barcode or QR code based on the target image being included, and output a search result to detect whether the code is authentic.

[0030] FIG. 1 is a diagram illustrating a system according to an example.

[0031] Referring to FIG. 1 , the system may include an electronic apparatus

100, a user terminal device 200, and an external device 300.

[0032] The electronic apparatus 100 may sequentially receive a plurality of printing media (e.g., paper) including an image. The electronic apparatus 100 may receive image data of a front surface and a rear surface included in a printing medium sequentially supplied. For example, the electronic apparatus 100 may include a front image sensor and a rear image sensor, and may sense an image included in the front surface of the printing medium and an image included in the rear surface of the printing medium using the front and rear image sensors. The electronic apparatus 100 may detect whether a target image is included in the front or rear image of the printing medium based on the sensed image data of the front and rear images and detect whether the target image is authentic. For example, the target image may include a banknote, a barcode, a QR code, and the like.

[0033] The electronic apparatus 100 may process the sensed image data to detect whether sensitive information is included on a front surface or a rear surface of the printing medium. For example, the electronic apparatus 100 may convert the image of the sensed printing medium into a mono image if the image of the sensed printing medium is a color image. As an example, if the front image of the sensed printing medium is a color image, the electronic apparatus 100 may convert the front image into a mono image, and if the rear image of the sensed printing medium is a color image, the electronic apparatus 100 may convert the rear image into a mono image. If the sensed front and rear images are both color images, the electronic apparatus 100 may convert both the front and rear images into mono images. The electronic apparatus 100 may convert the resolution of the converted mono image to a reference resolution. An example process of detecting by the electronic apparatus 100 of whether sensitive information is included will be described below. The electronic apparatus 100 may detect whether an image of the printing medium is a target image based on the image converted based on the reference resolution, and detect whether the target image is authentic.

[0034] For example, if the target image is a banknote, the electronic apparatus 100 may output a detection result of the banknote. The electronic apparatus 100 may output a detection result through an output interface of the electronic apparatus 100, and may perform a printing process by adding an indicator indicating a banknote to the sensed image (e.g., page including an image). For example, the indicator may indicate that the image sensed by the user has been detected to be a banknote, and may be a term indicating the corresponding sensitive information such as "specimen", "confidential information", and the like. In addition, the indicator may be expressed in the form of a warning phrase, a specific color, a specific figure, a specific pattern, or the like. The electronic apparatus 100 may transmit a detection result to the user terminal device 200.

[0035] The user terminal device 200 may display a detection result received from the electronic apparatus 100. For example, the user terminal device 200 may include a smartphone, a desktop personal computer (PC), a laptop PC, and the like.

[0036] For example, the target image may be a barcode or a QR code. The electronic apparatus 100 may sense an image of the printing medium in the same manner as described above and may process the sensed image. The electronic apparatus 100 may identify a barcode image of a barcode or a QR code image of a QR code from a sensed image, and extract code information from the identified barcode image or QR code image. The electronic apparatus 100 may transmit the extracted code information to the external device 300.

[0037] The external device 300 may search for product information based on the received code information. For example, the external device 300 may include a server, a cloud, and the like. The external device 300 may transmit retrieved product information to the electronic apparatus 100. The electronic apparatus 100 may display received product information. The electronic apparatus 100 may detect whether a barcode or a QR code is authentic according to whether product information corresponding to the code information is received from the external device 300.

[0038] In an example, the electronic apparatus 100 may transmit the product information received from the external device 300 to the user terminal device 200. The user terminal device 200 may display product information received from the electronic apparatus 100.

[0039] Hereinafter, an example of the electronic apparatus 100 is described.

[0040] FIG. 2 is a block diagram illustrating an electronic apparatus according to an example.

[0041] Referring to FIG. 2, the electronic apparatus 100 may include an automatic document feeder 110 and a processor 120. The automatic document feeder 110 may include a front image sensor 111 and a rear image sensor 112. [0042] The automatic document feeder 110 may sequentially supply a plurality of print media including an image. The front image sensor 111 may sense a front image of the printing medium, and the rear image sensor 112 may sense a rear image of the printing medium.

[0043] The processor 120 may control an operation of the electronic apparatus 100. Based on the electronic apparatus 100 receiving a command for detecting whether sensitive information is included in a target image, the processor 120 may receive front image data and rear image data from the front image sensor 111 and the rear image sensor 112, respectively. The processor 120 may convert the front image data and the rear image data to a reference resolution using a separate resolution conversion block. The reference resolution may include a horizontal resolution (i.e. , width) and a vertical resolution (i.e., height). For example, the processor 120 may convert the vertical resolution of the image based on the vertical resolution of the reference resolution.

[0044] Based on the vertical resolution of the image being converted based on the vertical resolution of the reference resolution, the horizontal resolution of the image may deviate from the horizontal resolution of the reference resolution. The processor 120 may additionally perform a process of downscaling the horizontal resolution of the image to the reference horizontal resolution based on the horizontal resolution of the image deviating from the reference horizontal resolution.

[0045] The processor 120 may alternately process the front image and the rear image using the image converted to the reference horizontal resolution and the reference vertical resolution to detect whether sensitive information is included in the front image and the rear image, respectively. The processor 120 may detect whether the sensitive information is included based on front and rear band images. A band may be a unit to detect whether the sensitive information is included. That is, a unit of image data corresponding to a number of lines set to detect whether the sensitive information is included is referred to as a band. The processor 120 may detect whether sensitive information is included in the image in units of band images for each of the front image data and the rear image data. For example, the processor 120 may detect whether sensitive information is included in the image of the other surface while the resolution of one surface of the front surface or the rear surface is converted to the reference resolution. For example, the image to be detected as to whether the sensitive information is included may include a banknote, a barcode, a QR code, and the like.

[0046] If the target image is a banknote, the processor 120 may extract a signal of a frequency component of the image converted to the reference horizontal resolution and the reference vertical resolution. The processor 120 may analyze a signal of the extracted frequency component and detect whether it is a banknote. If it is detected that the front or rear image of the printing medium is a banknote, the processor 120 may control the electronic apparatus 100 so that page information including the banknote is displayed as a preview image on the entire supplied printing medium, and an indicator is added to the page including the banknote so as not to print a page including a display or a banknote.

[0047] Based on the target image being a barcode or a QR code, the processor 120 may identify the barcode image or the QR code image from the image converted to the reference horizontal resolution and the reference vertical resolution. The processor 120 may extract code information from the identified barcode image or the QR code image. The processor 120 may detect whether the extracted code information is authentic using the external device.

[0048] If the received front or rear image is a color image, the processor 120 may convert the color image to a mono image.

[0049] FIG. 3 is a block diagram illustrating an electronic apparatus according to an example.

[0050] Referring to FIG. 3, the electronic apparatus 100 may include the automatic document feeder 110, the processor 120, an input interface 130, a communication interface 140, a display 150, a speaker 160, a memory 170, and a printer engine 180. The automatic document feeder 110 may include the front image sensor 111 , the rear image sensor 112, and a paper detection sensor 113. [0051] The automatic document feeder 110 and the processor 120 perform similar functions to the automatic document feeder 110 and the processor 120 of FIG. 2, such that an overlapping description will be omitted and examples added to FIG. 3 will be described below.

[0052] The paper detection sensor 113 included in the automatic document feeder 110 may sense a supplied printing medium. The processor 120 may detect a number (e.g., length) of lines of the printing medium on the basis of the time for sensing the printing medium by the paper detection sensor 113. The processor 120 may detect a size of a band image based on the image and the detected number of lines.

[0053] The input interface 130 may receive a function selection and a control command for a corresponding function from a user. The function may include a printing function, a copy function, a scan function, a fax transmission function, and the like. The input interface 130 may receive a command for detecting whether sensitive information is included in the target image. The input interface 130 may be referred to as an input unit, an input module, an input interface, and the like.

[0054] The communication interface 140 may perform communication with an external device. For example, the external device may include a server, an Al cloud, an image forming apparatus, or the like. The communication interface 140 may connect the electronic apparatus 100 with the external device via a local area network (LAN), an Internet network, and/or a connection through a universal serial bus (USB) port or a wireless communication port (e.g., WiFi 802.11a/b/g/n, Near Field Communication (NFC), Bluetooth). The communication interface 140 may be referred to as a communicator, a communication module, a communication device, a transceiver, or the like.

[0055] If the target image includes a banknote, the communication interface 140 may transmit the result detected as the banknote to the user terminal device 200. If the target image is a barcode or a QR code, the communication interface 140 may transmit extracted code information to the external device 300, and receive product information corresponding to the code information from the external device 300. The communication interface 140 may transmit the received product information to the user terminal device 200.

[0056] The display 150 may display a user interface window for receiving a function supported by the electronic apparatus 100. The display 150 may display a user interface window for receiving various functions provided by the electronic apparatus 100. If the image of the printing medium is detected to be a banknote, the display 150 may display a detection result. If the image of the printing medium is a barcode or a QR code, the display 150 may display the product information received from the external device 300. The display 150 may be a monitor, such as a liquid crystal display (LCD), a cathode ray tube (CRT), a light emitting diode (LED) display, an organic LED (OLED) display, or the like, and may be implemented as a touch screen capable of performing functions of the input interface 130 at the same time.

[0057] The speaker 160 may output state information of the electronic apparatus 100 as sound. For example, if the electronic apparatus 100 is in an error state, a sound corresponding to an error state may be output. [0058] The memory 170 may store at least one instruction regarding the electronic apparatus 100. For example, the memory 170 may store various programs (e.g., machine readable instructions) to operate the electronic apparatus 100 according to various examples. The memory 170 may store data resulting from scanning the front surface and the rear surface of the print medium, data before and after image processing, or the like.

[0059] The printer engine 180 may form an image. For example, the printer engine 180 may print a print image generated by the processor 120 on the printing medium. The printer engine 180 may perform printing in an electrophotographic manner, an inkjet manner, or the like. The printer engine 180 may be a mono print engine capable of printing one color, or may be a color printer engine capable of color printing.

[0060] If sensitive information is included in the image of the printing medium or the authenticity is determined, the printer engine 180 may print a message instead of the image or print an indicator added by the processor 120 to the image (e.g., a page including the image) of which authenticity is detected or which includes sensitive information.

[0061] FIG. 4 is a diagram illustrating an automatic document feeder according to an example.

[0062] Referring to FIG. 4, the automatic document feeder 110 may include the front image sensor 111, the rear image sensor 112, and the paper detection sensor 113.

[0063] The front image sensor 111 may be disposed in one area of the automatic document feeder 110 on the basis of a printing medium transfer line in the automatic document feeder 110, and may sense an image of the front surface of a supplied printing medium. The rear image sensor 112 may be disposed in another area of the automatic document feeder 110 based on the printing medium transfer line in the automatic document feeder 110, and may sense an image of a rear surface of the supplied printing medium. The processor 120 may receive the front image data sensed by the front image sensor 111 and the rear image data sensed by the rear image sensor 112, and change a resolution to a reference resolution. The processor 120 may store a front band image of the front image data changed to the reference resolution and a rear band image of the rear image data in different buffers, respectively, and process the front and rear band images to detect whether the sensitive information is included, respectively.

[0064] The paper detection sensor 113 may be disposed in a previous region of the automatic document feeder 110 than the front image sensor 111 and the rear image sensor 112 on the basis of the printing medium transfer line in the automatic document feeder 110. The paper detection sensor 113 included in the automatic document feeder 110 may sense the supplied printing medium. The processor 120 may detect the number (e.g., length) of the printing medium on the basis of the time for sensing the printing medium by the paper detection sensor 113, and detect the size (e.g., length) of the band image.

[0065] The time interval between which the paper detection sensor 113 may sense one printing medium and sense the next printing medium may be referred to as a paper gap. The processor 120 may control the start and end of the process of detecting the target image based on the paper gap.

[0066] FIG. 5 is a diagram illustrating a gap of a printing medium according to an example.

[0067] Referring to FIG. 5, the front image sensor 111, the rear image sensor 112, and the paper detection sensor 113 are illustrated.

[0068] For example, a plurality of printing media may be sequentially supplied. While one printing medium passes through the paper detection sensor 113, the paper detection sensor 113 may sense the printing medium. Based on one printing medium passing through the paper detection sensor 113, a spatial/temporal interval 1 may occur until the paper detection sensor 113 detects the next printing medium. The time interval 1 between the time at which the paper detection sensor 113 senses one printing medium and the time at which the next print medium is sensed may be referred to as a paper gap.

[0069] The paper detection sensor 113 may obtain a time at which one printing medium is sensed. The electronic apparatus may calculate the length of the printing medium based on the obtained time to detect the number of lines. The number of lines of the detected printing medium may be used as a length of an image and may be used as a length of a band image that is an image processing unit. In addition, the image processing apparatus may perform an image processing process for detecting whether the sensitive information is included during the time of the paper gap.

[0070] The electronic apparatus may process the sensed image and detect whether the sensitive information is included in the target image (e.g., the set image) on the basis of the image-processed image. For example, the target image may include a banknote, a barcode, a QR code, and the like.

[0071] FIG. 6 is a diagram illustrating page control according to an example. [0072] Referring to FIG. 6, an electronic apparatus may set information of a printing medium including an image in operation S610. The electronic apparatus may set information of an image to be processed in a paper gap state to a resolution conversion block (e.g., a banknote thread block). For example, the setting information may include a front or rear image, a resolution, an address of a buffer in which an image is stored, and the like.

[0073] Based on the printing medium passing the paper detection sensor, the electronic apparatus may perform resolution conversion on the input image and input the converted image to a detected block (e.g., a banknote detection block), and store the result in each page in operation S620. Based on the printing medium passing through the paper detection sensor, the resolution conversion block may recognize a page end and may adjust the length of the band to terminate control of the image buffer. The resolution conversion block may wait to set the next printing medium in operation S630. The detection block may detect the banknote based on the converted image, and output a detection result in operation S640.

[0074] An example process of detecting the banknote, the barcode, and the QR code will be described below.

[0075] FIG. 7 is a diagram illustrating a banknote according to an example. [0076] Referring to FIG. 7, the processor may generate each of the sensed front and rear image data as a band image and generate a message associated with the generated band image. The generated band image and message may be transmitted to a resolution conversion block (e.g., a banknote thread block). The resolution conversion block may parse the delivered message and change the resolution of the band image to a reference resolution. The resolution conversion block may switch the front band image and the rear band image and perform an image processing process. The resolution conversion block may store the front and rear band images that have been changed to the reference resolution in separate buffers, respectively.

[0077] The front and rear band images stored in separate buffers may alternatively be transferred to a decision block (e.g., a banknote sensing image processor). For example, the detection block may receive the front band image from the front image buffer, detect whether there is a banknote, and store the detection result. Based on the detection of the banknotes for the front band image being completed, the detection block may receive the rear band image from the rear image buffer to detect whether there is a banknote, and store the detection result. The detection block alternately receives the front band image and the rear band image and sequentially processes the front band image and the rear band image to store the detection result.

[0078] FIG. 8 is a diagram illustrating a process of detecting a banknote according to an example.

[0079] Referring to FIG. 8, an example operation of a resolution conversion block is shown. The processor may store a generated image in a buffer in units of bands to detect whether there is a banknote in an adaptation level. In FIG. 8, the F1 band is the first band of the front surface, the F2 band is the second band of the front surface, and the B1 band refers to the first band of the rear surface. The electronic apparatus may sense an image of the front and rear surfaces. The electronic apparatus may store a band of the front image in the first buffer, and may store a band of the rear image in the second buffer. Based on storing of the F1 band being completed, the adaptation layer block may generate a message indicating the end of the storage of the F1 band and transmit the message to the resolution conversion block. In addition, based on the storage of the F2 band and the B1 band being completed, the adaptation layer block may generate a message and transmit the message to the resolution conversion block.

[0080] The resolution conversion block (e.g., banknote thread block) may store the received message. The resolution conversion block may sequentially analyze stored messages based on performing an image processing process. For example, the resolution conversion block may perform a task according to a priority.

[0081] FIG. 9 is a flowchart illustrating a process of detecting a banknote according to an example.

[0082] Referring to FIG. 9, an example operation process of a resolution conversion block is shown. The resolution conversion block may parse and analyze a stored message in operation S910. The resolution conversion block may receive input/output information in operation S920. For example, the input information may include a resolution, a buffer address, a width (e.g., a horizontal length), a height (e.g., a vertical length), etc., and the output information may include a buffer address, a width (e.g., a horizontal length), a height (e.g., a vertical length), and the like. Based on using a cache, the resolution conversion block may perform a process to match data between the cache and the memory after a direct memory access (DMA) memory termination in operation S930. [0083] The resolution conversion block may analyze the message to process the F1 band. The resolution conversion block may detect whether the resolution conversion block is a front or rear image, and may convert the resolution conversion block to a reference resolution based on the vertical resolution in operation S940. For example, the image of the F1 band may be 100 x 200 dpi resolution, and the vertical resolution of the reference resolution may be 100 dpi. The resolution conversion block may detect a front image, and the resolution conversion process may be performed by setting the vertical resolution scale to 1/2 in operation S950-1. As shown in FIG. 9, if the vertical resolution is 150 dpi, the resolution conversion block may set the vertical resolution scale to 2/3 in operation S950-2, and if the vertical resolution is 100 dpi, the vertical resolution scale may be set to 1/1 in operation S950-3.

[0084] The resolution conversion block may perform a process for matching the data between the cache and the memory after the resolution conversion process is finished in operation S960. In operation S970, the resolution conversion block may change the band height for the reduced band image based on completion of the conversion process of the vertical resolution. The resolution conversion block terminating the image processing for the band of the front image may perform a process of changing the address from the first buffer to the second buffer for image processing on the band of the rear image in operation S980.

[0085] FIG. 10 is a diagram illustrating a process for processing a band according to an example.

[0086] Referring to FIG. 10, the resolution conversion block may perform a resolution change process on the F1 band and the F2 band. For example, the resolution conversion block may downscale the horizontal resolution if the horizontal resolution of the image converted to the reference resolution exceeds the reference horizontal resolution. For example, the resolution conversion block may perform a resolution change with respect to the F1 band and the F2 band for half reduction. The resolution conversion block may store two bands in different buffers for sensing banknotes. The vertical resolution may be the height of the band. Input/output image information may be needed to change the height of the band. For example, the input information may include a resolution, a buffer address, a width, a height, etc., and the output information may include a buffer address, a width, a height, and the like.

[0087] For example, if the reference resolution is 100 ^c 100 and the sensed image is 300 ^c 600, the electronic apparatus may convert the sensed image to ½ based on the reference vertical resolution. That is, the electronic apparatus may change the resolution of the image having a resolution of 300 ^c 600 to a resolution of 100 x 200. The modified horizontal resolution exceeds the reference resolution. Thus, the electronic apparatus may downscale the horizontal resolution. The electronic apparatus may downscale the horizontal resolution to 1/2 to downscale the band to 100 ^c 100 and detect whether the sensitive information is included based on the downscaling band.

[0088] The resolution conversion block may integrate the band with the changed resolution into one band and detect whether the band is a banknote based on the integrated band. That is, the resolution conversion block may integrate a plurality of bands included in the F1 band into one band or integrate a plurality of bands included in the F2 band into one band. The electronic apparatus may perform a detection process of whether to include sensitive information on a multi-band integrated with one band.

[0089] FIG. 11 is a diagram illustrating a process performed in parallel of detecting whether sensitive information is included according to an example. [0090] Referring to FIG. 11, the electronic apparatus may perform FIW processing and SW processing. For example, the FIW processing may include a process of detecting an image and converting the image into a mono image, and the SW processing may include changing a resolution and detecting whether the sensitive information is included.

[0091] As shown in FIG. 11, the electronic apparatus may sense a first image (e.g., an F1 band) of a front surface of a first page and convert the image into a mono image. The electronic apparatus may detect a first image (B1 band) of a rear surface of the first page while performing an FIW process on the image of the front surface of the first page and convert the image into a mono image. In addition, the electronic apparatus may perform an SW process on the sensed band while performing an FIW process on the image of the printing medium. For example, the electronic apparatus may sense a second image (e.g., an F2 band) of the front surface of the second page and detect whether to include sensitive information for the F1 band while converting the image into a mono image. The electronic apparatus may detect a second image (e.g., a B2 band) of the rear surface of the second page and detect whether the sensitive information is included for the B1 band while converting the second image (e.g., a B2 band) of the rear surface of the second page into a mono image.

[0092] In other words, the electronic apparatus may detect whether the sensitive information is included in the image of the other surface while converting the resolution of one surface of the front surface or the rear surface to the reference resolution, thereby sequentially detecting whether the sensitive information is included on the front and rear images sequentially (e.g., almost simultaneously) without delay.

[0093] FIGS. 12A to 12C are diagrams illustrating a result of detecting whether sensitive information is included according to an example.

[0094] The electronic apparatus may, if it is detected that sensitive information (e.g., a banknote) has been included in the image, output a message, add an indicator, and the like.

[0095] For example, as shown in FIG. 12A, the electronic apparatus may additionally display a warning message to an image detected to include sensitive information. Alternatively, the electronic apparatus may add an indicator to an image detected to include sensitive information, and display or print an image to which the indicator is added. Alternatively, the electronic apparatus may transmit (e.g., output) an image to which the indicator is added to an external device. [0096] If it is detected that sensitive information is included in the image, as shown in FIG. 12B, the electronic apparatus may display a warning message. Alternatively, the electronic apparatus may control the printing engine so as not to print an image including the sensitive information. The electronic apparatus may display a detection result. For example, if it is detected that sensitive information is included in a front image in page 3, a rear image on page 8, and a front and rear image on page 10 of a continuously supplied printing medium, the electronic apparatus may display a detection result, as shown in FIG. 12C. Alternatively, the electronic apparatus may transmit (e.g., output) a detection result to an external device.

[0097] FIG. 13 is a flow diagram illustrating a process of detecting whether sensitive information is included according to an example.

[0098] Referring to FIG. 13, the electronic apparatus 100 may scan front and rear surfaces of a supplied printing medium in operation S1310. The scanned front image may be stored in a first buffer and the scanned rear image may be stored in a second buffer. The scanned image may be a band that is an image processing unit.

[0099] The electronic apparatus 100 may perform image processing on the scan image in operation S1320. For example, the electronic apparatus 100 may convert the scanned image to mono if the scanned image is a color image. The electronic apparatus 100 may convert a vertical resolution of the scanned image based on a reference vertical resolution. The electronic apparatus 100 may adjust a height of a band based on the converted vertical resolution. If a horizontal resolution of the transformed band exceeds a reference horizontal resolution, the electronic apparatus 100 may downscale the horizontal resolution of the band. [00100] The electronic apparatus 100 may change the resolution of the stored band and detect whether the sensitive information is included while the image is scanned and converted into a mono image in operation S1330. The electronic apparatus 100 may output a detection result in operation S1350-2. For example, the electronic apparatus 100 may output a warning message or add a warning message to output the image, or add an indicator to the image to print an image to which the indicator is added. Alternatively, the electronic apparatus 100 may not print a page including the image detected as the sensitive information.

[00101] The electronic apparatus 100 may transmit a detection result to the user terminal device 200 in operation S1340. The user terminal device 200 may output a detection result received similarly to the electronic apparatus 100 in operation S 1350-1.

[00102] As described above, a target image may include a barcode, a QR code, etc., in addition to a banknote. Hereinafter, an example where a barcode and a QR code are included in an image will be described.

[00103] FIG. 14 is a diagram illustrating a process for detecting a code according to an example.

[00104] Referring to FIG. 14, a process of detecting whether a QR code is authentic may be similar to the process of detecting whether a banknote is authentic. The electronic apparatus may scan front and rear images and convert a vertical resolution of the scanned image based on a reference vertical resolution. In addition, based on a horizontal resolution of the converted image exceeding a reference horizontal resolution, the electronic apparatus may downscale the horizontal resolution. The electronic apparatus may identify a barcode image or a QR code image based on the image that has been changed to a reference resolution. The electronic apparatus may extract code information from the identified barcode image or QR code image. The electronic apparatus may transmit the extracted code information to an external device to receive a result of authenticity.

[00105] FIG. 15 is a diagram illustrating a process of detecting whether a code is authentic according to an example.

[00106] Referring to FIG. 15, an electronic apparatus may extract code information from an image included in a continuously supplied printing medium and display code information. The electronic apparatus may transmit the extracted code information to an external device. The external device may retrieve corresponding product information based on the received code information. The external device may transmit the retrieved product information to the electronic apparatus. The electronic apparatus may output product information received from the external device. The electronic apparatus may display product information using a display or transmit the product information to the external device.

[00107] FIG. 16 is a flow diagram illustrating a process of detecting whether a code is authentic according to an example.

[00108] Referring to FIG. 16, the electronic apparatus 100 may scan a front and rear surface of a supplied printing medium in operation S1610. The scanned front image may be stored in a first buffer and the scanned rear image may be stored in a second buffer. The scanned image may be a band that is an image processing unit.

[00109] The electronic apparatus 100 may perform image processing on the scan image in operation S1620. For example, the electronic apparatus 100 may convert the scanned image to mono if the scanned image is in color. The electronic apparatus 100 may convert a vertical resolution of the scanned image based on a reference vertical resolution. The electronic apparatus 100 may adjust a height of the band based on the converted vertical resolution. If a horizontal resolution of the transformed band exceeds a reference horizontal resolution, the electronic apparatus 100 may downscale the horizontal resolution of the band. [00110] The electronic apparatus 100 may identify the barcode image or the

QR code image based on the band of which resolution is changed in operation S1630, and extract the code information from the barcode image or the QR code image in operation S1640. The electronic apparatus 100 may transmit the code information to the external device 300 in operation S1650. For example, the external device 300 may include a server, a cloud, a database, and the like. [00111] The external device 300 may search product information corresponding to the received code information in operation S1660, and transmit the searched product information to the electronic apparatus 100 in operation S1670. The electronic apparatus 100 may transmit the received product information to the user terminal device 200 in operation S1680, and output the received product information in operation S1690-2. The user terminal device 200 may output the product information received from the electronic apparatus 100 in operation S1690-1. Through the above-described process, the electronic apparatus 100 may detect whether the barcode or QR code included in the image is authentic.

[00112] FIG. 17 is a flowchart illustrating a process of detecting authenticity according to an example.

[00113] Referring to FIG. 17, an electronic apparatus may receive front image data and rear image data in operation S1710. The electronic apparatus may receive a command to detect whether sensitive information is included in an image from a user. The electronic apparatus may continuously receive a printing medium including an image through an automatic document feeder. The automatic document feeder may include a front image sensor and a rear image sensor. The front image sensor may sense the front image data of the printing medium, and the rear image sensor may sense the rear image sensor of the printing medium.

[00114] The automatic document feeder may include a paper detection sensor. The paper detection sensor may sense a supplied printing medium. The electronic apparatus may detect a number of lines forming an image on the printing medium on the basis of the time for sensing the printing medium in the paper detection sensor. In addition, the electronic apparatus may identify image data corresponding to a set line number among the detected number of lines as one band image that is a unit to detect whether the sensitive information is included. The electronic apparatus may store the identified front band image and the rear band image in different buffers, respectively. If the front image data or rear image data is color data, the electronic apparatus may convert the data to mono data. [00115] The electronic apparatus may change the front and rear image data to a reference resolution in operation S1720, and detect whether the front image and the rear image include sensitive information in operation S1730. The electronic apparatus may change the front image data and the rear image data to a reference resolution for performing a detection on whether sensitive information is included in the image data through a separate resolution block. The electronic apparatus may downscale the horizontal resolution if the horizontal resolution of the image changed to the reference resolution exceeds the reference horizontal resolution. The electronic apparatus may adjust the height of the band based on the changed vertical resolution.

[00116] The electronic apparatus may store the front image data and the rear image data, which have been changed to a reference resolution, in a separate buffer in units of front and rear band images, respectively. The electronic apparatus may alternately detect whether sensitive information is included in front and rear band images stored in a buffer in a detection block.

[00117] Based on the target image including a banknote, the electronic apparatus may extract a frequency of the image from the band image and detect whether the target image is a banknote based on the extracted frequency. If the electronic apparatus determines that the image is a banknote, the electronic apparatus may add a warning message to the image or display a separate warning message. Alternatively, the electronic apparatus may add an indicator to the image detected as a banknote, and print an image to which the indicator is added. Based on the target image being a barcode or QR code, the electronic apparatus may identify the barcode image or the QR code image from the band image and extract the code information from the identified barcode image or QR code image. The electronic apparatus may transmit the extracted code information to an external device. The external device may search product information corresponding to the extracted code information and transmit the retrieved product information to the electronic apparatus. The electronic apparatus may display the received product information. Based on there being no product information corresponding to the code information, the electronic apparatus may detect a barcode or a QR code as the above information. [00118] FIG. 18 is a diagram illustrating instructions stored in a non- transitory computer-readable recording medium according to an example. [00119] An example process of detecting a subject image performed in an electronic apparatus as described above may be embodied in a form of non- transitory computer readable storage media for storing instructions or data executable by a computer or processor. A non-transitory computer-readable recordable medium 1800 may store instructions related to an example operation of an electronic apparatus as described above. For example, a non-transitory computer-readable recording medium 1800 may include instructions 1810 to receive front image data and rear image data from a front image sensor and a rear image sensor included in an automatic document feeder for supplying a printable media, instructions 1820 to change the front image data and the rear image data to a reference resolution to perform detection on whether sensitive information of the image data is included through a separate resolution conversion block, respectively, and instructions 1830 to, by using the front image data and the rear image data changed to the reference resolution by distinguishing the band image, respectively, and alternately processing the front and rear band images, detect whether the sensitive information is included in the front image and the rear image.

[00120] Such computer-readable recordable media may include read-only memory (ROM), random-access memory (RAM), flash memory, CD-ROMs, CD- Rs, CD+Rs, CD-RWs, CD+RWs, DVD-ROMs, DVD-Rs, DVD+Rs, DVD-RWs, DVD+RWs, DVD-RAMs, BD-ROMs, BD-Rs, BD-R LTHs, BD-REs, magnetic tapes, floppy disks, magneto-optical data storage device, optical data storage devices, hard disks, solid-state disks (SSDs), and can be any device capable of storing machine readable instructions, associated data, datafiles, data structures, and providing machine readable instructions, associated data, datafiles, and data structure to the processor or computer so that the processor or computer can execute instructions.

[00121] While the disclosure has been shown and described with reference to various examples thereof, it will be understood that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic apparatus comprising: an automatic document feeder to supply printing medium and including a front image sensor and a rear image sensor to detect a front image and a rear image of the supplied printing medium, respectively; and a processor, wherein the processor is to: receive front image data and rear image data from the front image sensor and the rear image sensor, change the front image data and the rear image data to a reference resolution through separate resolution conversion blocks, and detect whether sensitive information is included in the front image and the rear image by dividing the front image data and the rear image data changed to a reference resolution into band images by using a detection block to alternately process front and rear band images.

2. The electronic apparatus of claim 1, wherein the automatic document feeder further comprises a paper detection sensor, wherein the processor is to: detects a number of lines forming an image on the printing medium based on a time for detecting a printing medium in the paper detection sensor, and identify image data corresponding to a set line number among the detected number of lines as one band image that is a unit to detect whether the sensitive information is included.

3. The electronic apparatus of claim 1 , further comprising: a printer engine, wherein, in response to a plurality of printing media being supplied to the automatic document feeder, the processor is to control the printer engine so that all the plurality of printing media do not print a page including a banknote.

4. The electronic apparatus of claim 3, wherein, in response to the plurality of printing media being supplied to the automatic document feeder, the processor is to output information about a page including the banknote as a preview image for all the plurality of printing media.

5. The electronic apparatus of claim 4, wherein, in response to the plurality of printing media being supplied to the automatic document feeder, the processor is to add an indicator to the page including the banknote and print the page including the banknote and the indicator or output a preview image for all the plurality of printing media.

6. The electronic apparatus of claim 1 , wherein the processor is to: store the front image data and rear image data changed to the reference resolution to a separate buffer in a unit of front and rear band images, respectively, and detect whether sensitive information is included by alternating front and rear band images stored in the buffer in the detection block.

7. The electronic apparatus of claim 1 , wherein the processor, based on the received front image data or rear image data being color data, is to convert the data to mono data.

8. The electronic apparatus of claim 1 , wherein the processor, based on a banknote being included in the front image or the rear image, is to: analyze a frequency component from the front or rear band images using the detection block, and detect whether the banknote is included in the front image and the rear image.

9. The electronic apparatus of claim 1 , wherein, the processor, based on the front image or the rear image including a barcode or a quick response (QR) code, is to: identify a code image from the front image or the rear image using the detection block, and identify whether the code is authentic from the identified code image.

10. The electronic apparatus of claim 9, further comprising: a communication interface, wherein the processor is to: based on the front image or the rear image including the barcode or the QR code, identify the code images from each of the front image or the rear image using the detection block, extract code information from the identified code image and transmit the code information to an external device using the communication interface, receive product information corresponding to the code information from the external device, and output the received product information.

11. A method of detecting whether an image includes sensitive information, the method comprising: receiving front image data and rear image data from a front image sensor and a rear image sensor included in an automatic document feeder supplying printing medium; changing the front image data and the rear image data to a reference resolution through separate resolution conversion blocks; and detecting whether sensitive information is included in the front image and the rear image by dividing front image data and rear image data changed to a reference resolution into band images by using a detection block to alternately process front and rear band images.

12. The method of claim 11 , further comprising: detecting a number of lines forming an image on the printing medium based on a time for detecting a printing medium in a paper detection sensor; and identifying image data corresponding to a set line number among the detected number of lines as one band image that is a unit to detect whether the sensitive information is included.

13. The method of claim 11 , further comprising: storing the front image data and rear image data changed to the reference resolution to a separate buffer in a unit of front and rear band images, wherein the detecting whether the sensitive information is included comprises detecting whether sensitive information is included by alternating front and rear band images stored in the buffer in the detection block.

14. The method of claim 11 , further comprising: based on the received front image data or rear image data being color data, converting the data to mono data.

15. A non-transitory computer readable recoding medium recorded with a program for performing a method of detecting whether an image includes sensitive information, the non-transitory computer readable recoding medium comprising: instructions to receive front image data and rear image data from a front image sensor and a rear image sensor included in an automatic document feeder for supplying a printable media; instructions to change the front image data and the rear image data to a reference resolution through a separate resolution conversion block, respectively; and instructions to, by using the front image data and the rear image data changed to the reference resolution by distinguishing a band image, respectively, and alternately processing a front and a rear band image, detect whether the sensitive information is included in a front image and a rear image.