JP7395674B2 - Image processing device, image processing method, and program - Google Patents

Description

The present invention relates to an image processing device, an image processing method, and a program.

The system reads the image of the document to generate image data, performs character recognition processing on the area in the image specified by the user in advance, and stores the image data in a folder whose folder name is the character string obtained from the character recognition processing. An image processing device for transmitting is disclosed. (See Patent Document 1).

Further, in the image processing device of Patent Document 1, character recognition processing is executed in a specified area, a folder whose folder name is a character string obtained by the character recognition processing is searched for, and image data is sent to that folder. .

Japanese Patent Application Publication No. 2005-234708

If the folder path of the folder to which image data is to be sent is entered one character at a time using a keyboard, it takes time and effort to enter the folder path. When entering a folder path that spans multiple levels, it takes more effort to enter the folder path.

In the method of Patent Document 1, character strings for one layer can be set by specifying an area, but multiple layers cannot be specified.

The present invention has been made in view of the above problems, and it is an object of the present invention to reduce the user's effort when setting a folder path consisting of multiple layers of a folder to which image data is to be transmitted.

The image processing device of the present invention includes an acquisition means for acquiring character information from an image of image data , a display means for displaying the image, and a display means for displaying a first image that is an image of the first image data. an image of second image data ; A file based on the second image is stored in a folder having a folder name including a character string indicated by the first character information obtained from the first area of the second image having the same size as the second image, The image processing apparatus is characterized by comprising an execution means for executing processing for storing a file having a file name including a character string indicated by the second character information acquired from the second area of the second image.

The user's effort when setting a folder path consisting of multiple layers of a folder to which image data is to be transmitted can be reduced.

Diagram showing an example of the configuration of a reading system A diagram showing an example of the hardware configuration of the MFP 101 A diagram showing an example of the hardware configuration of the PC 104 A diagram showing an example of a screen displayed on the operation unit 205 A diagram showing an example of a one-touch transmission scan setting screen displayed on the display device 311 Diagram showing an example of a button settings editing screen for executing a one-touch send scan Diagram showing an example of an address selection screen Diagram showing an example of a destination registration screen A diagram showing an example of the folder structure of the file server 102 that is the file transmission destination Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Diagram showing an example of the screen displayed when executing a one-touch send scan Flowchart showing an example of the flow when the one-touch send button for file sending is selected Flowchart showing an example of character recognition processing Flowchart showing an example of a flow in which the MFP 101 generates a text object Flowchart showing an example of the flow of string processing

EMBODIMENT OF THE INVENTION Hereinafter, the form for implementing this invention is demonstrated using drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.

FIG. 1 is a diagram showing an example of the configuration of a reading system according to the present invention. The reading system of this embodiment includes an MFP (Multi Function Peripheral) 101 that is an example of an image processing device, a file server 102 that is an information processing device, a mail server 103, and an online storage 106. Each of the MFP 101, file server 102, mail server 103, and online storage 106 is connected to a LAN (Local Area Network) 100. Further, on the LAN 100, an MFP 101, a file server 102, a mail server 103, and a PC 104 are connected to each other via a network so as to be able to communicate with each other. Further, the MFP 101 and the online storage 106 can communicate with each other via the LAN 100 and the Internet 105.

The MFP 101 reads an image of a document and sends generated image data to a file server 102, a mail server 103, and an online storage 106. Note that the image data in this embodiment is not limited to electronic data obtained by converting an image into RAW data, but may also be electronic data according to an image format such as TIFF or JPEG, or electronic data according to a PDF format. The file server 102 is a file server compatible with FTP (File Transfer Protocol) and SMB (Server Message Block) protocols. The mail server 103 is a mail server compatible with SMTP (Simple Mail Transfer Protocol). The online storage 106 is an online storage compatible with WebDAV (a file sharing protocol using HTTP). The PC 104 can access the web server included in the MFP 101 using HTTP, and can refer to and update setting values. The LAN 100 may be configured as a wired LAN using Ethernet (registered trademark) or may be configured as a wireless LAN.

FIG. 2 is a diagram showing an example of the hardware configuration of the MFP 101. The MFP 101 includes a CPU 201, a ROM 202, a RAM 203, a storage 204, an operation unit 205, a printer 206, a scanner 207, a network I/F (Interface) 208, and an external storage I/F 209.

The CPU 201 realizes each function of the MFP 101 by controlling various hardware 202 to 208 that make up the MFP 101. Note that the CPU 201 sends signals to various pieces of hardware via a bus line, thereby realizing mutual data communication with other pieces of hardware.

Further, the CPU 201 of the MFP 101 controls the operation of the MFP 101 according to a control program stored in the ROM 202. More specifically, the CPU 201 executes an operating system (OS) that controls the MFP 101 and a driver program that controls the hardware. Application programs placed on the OS mutually operate to operate and control functions desired by the user. These OS and various programs are stored in the ROM 202, and are executed by being read out in the RAM 203.

The ROM 202 is a memory for storing programs and various data used by the CPU 201. The RAM 203 is a work memory for temporarily storing programs and data used by the CPU 201 for calculations. The storage 204 is a storage device that stores various data, various programs, and the like.

Note that although a flash memory is assumed as the storage 204 in this embodiment, an auxiliary storage device such as an SSD, an HDD, or an eMMC may be used. Note that in the MFP 101, one CPU 201 uses one memory (RAM 203) to execute each process shown in a flowchart described later, but other forms may be used. For example, multiple CPUs, multiple RAMs, multiple ROMs, and multiple storages may cooperate to execute each process shown in a flowchart described later. Further, a part of the processing may be executed using a hardware circuit such as an ASIC or FPGA.

The operation unit 205 is a user interface such as a touch panel for the user to operate the MFP 101, and is a reception unit that receives operations and inputs from the user. Further, the operation unit 205 can also be used as a display unit that displays a screen etc. for operating the MFP 101.

The printer 206 is a unit that implements a print function, and the CPU 201 controls the printer 206 to execute a print job received from the PC 104 and prints an image on paper. Here, the print job is data that includes instructions for causing the MFP 101 to execute print processing, image data, print setting information, and the like.

The scanner 207 is a unit that implements a scanning function, and the CPU 201 controls the scanner 207 to optically read an image of a document and perform processing to generate image data.

The network I/F 208 is a network I/F for performing wired LAN communication, such as Ethernet. Note that this network I/F 208 may be a network I/F for performing wireless LAN communication, or may be a USB-LAN I/F or the like.

The external storage device I/F 209 is an I/F for the MFP 101 to communicate with the external storage device 210. The CPU 201 controls the external storage device I/F 209 to cause the external storage device 210 to store image data. In this embodiment, a USB interface is assumed as the external storage device I/F 209, and a USB memory is assumed as the external storage device 210, but the external storage device I/F 209 is an SD card for communicating with an external storage device such as an SD card. It may also be a card slot.

FIG. 3 is a diagram showing an example of the hardware configuration of the PC 104. The PC 104 includes a CPU 301, ROM 302, RAM 303, HDD 304, network I/F 305, operating device I/F 306, and display device I/F 307.

The CPU 301 realizes each function of the PC 104 by controlling various hardware 302 to 307 that make up the PC 104. Note that the CPU 301 sends signals to various pieces of hardware via a bus line, thereby realizing mutual data communication with other pieces of hardware.

Further, the CPU 301 of the PC 104 controls the operation of the PC 104 according to a control program stored in the ROM 302. More specifically, the CPU 301 executes an OS or the like that controls the PC 104. Application programs placed on the OS mutually operate to operate and control functions desired by the user. These OS and various programs are stored in the ROM 302, and are executed by being read out in the RAM 302.

The ROM 302 is a memory for storing programs and various data used by the CPU 201. The RAM 303 is a work memory for temporarily storing programs and data used by the CPU 201 for calculations. The HDD 304 is a storage device that stores various data, various programs, and the like.

The network I/F 305 is a network I/F for performing wired LAN communication, such as Ethernet. Note that this network I/F 305 may be a network I/F for performing wireless LAN communication, or may be a USB-LAN I/F or the like.

The operating device I/F 306 is an I/F for connecting an operating device 310 such as a keyboard or a mouse to the PC 104.

The display device I/F 307 is an I/F for connecting the display device 311 such as a liquid crystal monitor and the PC 104.

Note that although the PC 104 in this embodiment is connected to an external operating device and an external display device, the operating section and display section may be built into the PC 104, for example.

FIG. 4 is a diagram showing an example of a screen displayed on the operation unit 205. The operation unit 205 includes a touch panel 410, a Data LED 420, and an Error LED 430. A home screen 400 that is displayed immediately after the MFP 101 is started is displayed on the touch panel 410. Home screen 400 is a screen for instructing the execution of each function of MFP 101. The home screen 400 displays a frequently used setting button 401, a scan button 402, a menu button 403, an address book button 404, a medical questionnaire button 405, a letter of introduction button 406, and the like. Further, a power save button 407, a home button 408, and a stop button 409 are always displayed on the home screen 400. Note that the power save button 407, home button 408, and stop button 409 may be provided on the operation unit 205 as hard keys.

The frequently used setting button 401 is a button for displaying an execution screen for a specific function when selected by the user, with the settings set by the user being input.

The scan button 402 is a screen for executing scan processing to generate image data, and for sending the generated image data by email, sending a file, or storing it in the external storage device 210 when selected. This is a button that displays. Here, e-mail transmission refers to attaching image data generated by reading a manuscript to an e-mail and transmitting the image data. Furthermore, file transmission means transmitting to the file server 102, PC 104, etc. using a communication protocol such as SMB or FTP.

The menu button 403 is a button for displaying a menu screen when selected by the user.

The address book button 404 is a button that is selected by the user to display a screen that displays registered addresses (destination information). The address display screen displays transmission types such as e-mail transmission, SMB transmission, FTP transmission, and WebDAV transmission, and destination information such as mail address, host name, and server information.

The medical questionnaire button 405 and the letter of introduction button 406 are one-touch send buttons. The one-touch send button, when selected by the user, reads the image of the document using the scan settings preset by the user, generates image data, and sends the image data using the transmission type preset by the user. This button displays a screen for

The power saving button 407 is a button that, when selected by the user, causes the MFP 101 to enter a power saving state.

Home button 408 is a button for displaying home screen 400 on operation unit 205 when selected by the user.

A stop button 409 is a button that, when selected by the user, causes the MFP 101 to stop executing a job such as a print job that is currently being executed. Note that execution of the copy job or transmission job may be canceled by selecting the stop button 409 by the user.

DataLED 420 and ErrorLED 430 notify the user of the status of MFP 101. The Data LED 420 lights up during e-mail transmission or file transmission, and the Error LED 430 lights up when an error occurs in the MFP 101.

Note that the home screen 400 can be used by the user from a plurality of functions, including, for example, a copy function that prints based on image data, and a transmission function that can generate image data by reading a document and send the image data to an external device. This is a function selection screen for selecting a function to be used.

If you use the keyboard to enter the folder path of the folder to send image data one character at a time, it takes time to enter the folder path, and when entering a folder path that spans multiple levels, it is necessary to There is a problem that it takes time to input the pass.

In the method of Patent Document 1, character strings for one layer can be set by specifying an area, but multiple layers cannot be specified.

By executing the following process for this problem, it is possible to reduce the user's effort when setting a folder path consisting of multiple layers of a folder to which image data is to be transmitted.

FIG. 5 is a diagram showing an example of a one-touch transmission scan setting screen displayed on the display device 311.

The one-touch transmission scan setting screen 500 in FIG. 5 is displayed on the display device 311 connected to the PC 104 that is accessing the web server of the MFP 101 through HTTP communication, for example.

The one-touch transmission scan setting screen 500 displays application information 501, a new button registration button 502, items 503 to 506, a display/hide button 507, and a delete button 508.

The application information 501 is an area that displays the version of the application, and in FIG. 5, the version number 1.00 is displayed.

A new button registration button 502 is displayed on the screen displayed on the operation unit 205 when selected by the user, and is a button for registering a new button for executing a one-touch transmission scan. When the new button registration button 502 is selected, the settings editing screen 600 of FIG. 6 is displayed on the display device 311. A detailed explanation of the settings editing screen 600 in FIG. 6 will be given later.

Item 503 indicates the name of a button registered in MFP 101 for executing a one-touch transmission scan.

Item 504 indicates the transmission type set in the button for executing the one-touch transmission scan registered in the MFP 101.

Item 505 indicates the display state of a button registered in the MFP 101 for executing a one-touch transmission scan. Also displayed are a display/non-display switching button 506 and a delete button 507 for changing the display state. For example, when the display state of the "letter of introduction" button is "display", a button like the letter of introduction button 406 in FIG. 4 is displayed on the home screen 400 on the touch panel 410. The display/non-display switching button 506 is a button that can be toggled to select between "display" and "non-display" of the button.

When the delete button 507 is selected by the user, the button information registered in the MFP 101 is deleted.

As an example of a button for executing a one-touch transmission scan registered in the MFP 101, the transmission type of the button named "Application Form A" is e-mail, and the display state is hidden. Further, the settings editing screen 600 of FIG. 6 is displayed on the display device 311 not only when the new button registration button 502 is selected but also when the button name "Application Form A" is selected.

In FIG. 5, four buttons are registered: "Application Form A", "Application Form B", "Letter of Introduction", and "Question Sheet". Since the button display state of “letter of introduction” and “questionnaire” is “display”, the buttons are displayed on the home screen 400. However, since the display status of “Application Form A” and “Application Form B” is “hidden”, no buttons are displayed on the home screen 400.

FIG. 6 is a diagram showing an example of a button setting editing screen for executing a one-touch transmission scan. The button settings editing screen 600 in FIG. 6 is displayed on a display device 311 connected to the PC 104 that is accessing the web server of the MFP 101 via HTTP communication, for example.

The button setting editing screen 600 is displayed when the new button registration button 502 in FIG. 5 or the button name is selected by the user. When the button settings edit screen 600 is displayed as a result of the button name being selected by the user, each item on the button settings edit screen 600 is displayed with the previously set value entered. Ru. When the button settings editing screen 600 is displayed by selecting the new button registration button 502, each item on the button settings editing screen 600 is displayed with no value entered. Note that default values may be input in advance for each item on the button settings editing screen 600.

An input field 601 is an input field for setting the name of the one-touch transmission button. In the input field 601, a character string "letter of introduction" is input. Here, the one-touch transmission button is a button for executing a one-touch transmission scan when selected by the user.

A pulldown 602 is an object for setting a file name. In the pull-down 602, "button name" and "automatic" can be selected, and if "button name" is selected, the button name entered in the input field 601 becomes the name of the file to be transmitted. Furthermore, if "Automatic" is selected, the automatically determined character string becomes the file name. For example, the file name is the date and time when the one-touch send button registered on the screen of FIG. 6 was selected and scanned. Note that when an extension button 1501 on a medical questionnaire screen 1500, which will be described later, is selected and a character string indicating an extension is added, the setting based on the selection of the extension button 1500 is given priority and a file name is given.

When the check box 603 is checked, the keywords used when outputting a file are enabled. The keywords will be explained in detail with reference to FIG.

The keyword character string setting button 604 is a button for displaying the keyword character string setting screen 700 of FIG. 7 when selected by the user.

A pulldown 605 is an object for setting how to sort or not sort transmitted files. In the pulldown 605, one can be selected from "Do not sort," "Distribute (file)," "Distribute (folder)," and "Distribute (files and folders)." If "Do not sort" is set, keywords will not be used. If "Distribute (file)" is set, include the keyword in the output file name. If "Distribute (folder)" is set, include the keyword in the folder name that stores the file. If "Distribute (files and folders)" is set, keywords are included in the file name and the folder name to which the file is output. Detailed processing when each setting is set using this pulldown 605 will be explained with reference to FIGS. 16 and 17.

A pulldown 606 is an object for selecting the transmission type when transmitting the image data that has been read and generated. In the pulldown 606, "File", "Email", and "USB Memory" can be selected. When "File" is selected and the switching button 607 is selected, image data is sent to a folder in the PC 104 or to the file server 102 using a protocol such as SMB, FTP, WebDAV, or SFTP. Furthermore, if "E-mail" is selected, image data is sent to the destination using SMTP (Simple Mail Transfer Protocol). If "USB memory" is selected, the image data is stored in the USB memory, which is the external storage device 210 connected to the MFP 101.

A switch button 607 is a button for switching the transmission type setting to the transmission type displayed in the pulldown 606. Further, when the switching button 607 is selected with the transmission type selected in the pull-down 606, items corresponding to the selected transmission type are displayed in the item 608, item 609, etc.

Item 608 is an item in which various settings such as reading settings for reading with one-touch transmission scan and transmission settings for sending can be entered. For example, the item 609 includes settings such as the destination, reading size, file format, and document orientation.

An area 609 is an area for displaying the destination to which the image data that has been read and generated is to be sent. The destination set here is a folder path to be combined with the character string of the text object described later. An area 609 is a text area that cannot be entered or edited, and displays the address selected on the address selection screen. The selected address will be described later.

When selected by the user, the select from address book button 610 displays an address selection screen 800 from which an address in the address book stored in the MFP 101 can be selected.

A pull-down 611 is a pull-down for setting a file format for converting image data generated by reading an image on a document into a file. A file will be generated according to the format selected here.

The OK button 612 is a button for storing the settings of the one-touch send button in the storage 204 with the contents set on the button settings editing screen 600. When the OK button 612 is selected, the settings are stored in the storage 204. A cancel button 613 is a button for canceling settings. When the OK button 612 or the cancel button 613 is pressed, the one-touch transmission scan setting screen 500 of FIG. 5 is displayed.

FIG. 7 is a diagram showing an example of an address selection screen. The address selection screen 700 is displayed by selecting the select from address book button 610 on the button setting editing screen 600 in FIG. The address selection screen 700 in FIG. 7 is displayed, for example, on a display device 311 connected to the PC 104 that is accessing the web server of the MFP 101 through HTTP communication.

A pull-down 701 is a list for switching the type of address book displayed on the address selection screen 700. In the pulldown 701, either "Best Member" or "Speed Dial" (not shown) can be selected.

The display switching button 702 is a button that, when selected by the user, changes the type of address book displayed on the address selection screen 700 to the type displayed in the pull-down 701.

Area 703 is a display area where the name of the address book is displayed. A list 704 is an area where a list of addresses is displayed, and is composed of selectable checkboxes, numbers, types, names, and destinations. One of two types of checkboxes is displayed: checkable checkboxes and uncheckable checkboxes. The address management number is displayed. The type is an area where an icon is displayed, and the icon differs depending on the type of address. The name given to the address is displayed. The destination address is displayed. One of two types of checkboxes is displayed: checkable checkboxes and uncheckable checkboxes.

When the OK button 705 is selected with the checkbox checked, the address is displayed in the area 609. Furthermore, the MFP 101 stores the image data in the storage 204 as the destination address.

Supplement about the display of checkable and uncheckable checkboxes. FIG. 7 shows "Best Members" in which "File" is selected in the list 606 of FIG. 6, and two addresses with the sending type "Email" and two addresses with "File" are registered. This is the display when selecting an address from the address book. Checkable checkboxes are displayed for addresses that match the types in the pull-down 606. Specifically, uncheckable checkboxes are displayed for addresses numbered 01 and 02, and checkable checkboxes are displayed for addresses numbered 03 and 04.

The OK button 705 is a button for confirming address selection based on the settings set on the address selection screen. A cancel button 706 is a button for canceling the settings. When the OK button 705 or the cancel button 706 is selected, the button setting editing screen 600 shown in FIG. 6 is displayed.

Here, the settings of the medical questionnaire button 405 in this embodiment will be explained. The medical questionnaire button 405 is created by entering “medical questionnaire” in the input field 601, selecting “button name” from the pull-down 602, and checking the checkbox 603 on the button settings editing screen 600 in FIG. be done. The medical questionnaire button 405 is created by selecting "Distribute (folder)" from the pull-down 605 and selecting "File" from the pull-down 606 on the button settings editing screen 600 of FIG. In FIG. 7, the destination number 04 "\\file server\questionnaire" is selected for the "questionnaire" button.

FIG. 8 is a diagram showing an example of a destination registration screen. The destination registration screen 800 displays an input field 801, a pulldown 802, an input field 803, an input field 804, an input field 805, an input field 806, an OK button 807, and a cancel button 808. The destination registration screen 800 is a screen for registering a destination when the transmission type is file transmission.

The input field 801 is an input field for inputting the name of the destination. A pulldown 802 is an object for selecting a protocol to be used when transmitting image data to a destination. In the pulldown 802, one can be selected from three types: SMB, FTP, and WebDAV.

An input field 803 is an input field for entering the host name of the destination. Enter a resolvable server name or IP address. An input field 804 is an input field for inputting a destination folder path.

Input fields 805 and 806 are input fields for entering a user name and password for accessing the server specified by the host name input in input field 803.

When the OK button 807 is selected by the user, the CPU 201 stores the input setting value in the storage 204 as a new destination. When the cancel button 808 is selected by the user, settings are discarded and address book registration is canceled.

FIG. 9 is a diagram showing an example of the folder structure of the file server 102 that is a file transmission destination. A shared folder with the MFP 101 is created in the file server 102 for storing the medical questionnaire. With the medical questionnaire folder 901 as the top folder, subfolders 902 to 904 for each patient ID, subfolders 905 and 906 for each clinical department under each patient ID folder, and file names with the consultation date under each clinical department folder. The medical questionnaire files are configured as medical questionnaire files 907 to 909.

In FIGS. 10 to 16, as an example, the image data of the medical questionnaire that has been read and generated is sent from the MFP 101 to the otolaryngology folder 906 on the file server 102 with the file name "2018-09-05.pdf". explain.

FIG. 10 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan. The medical questionnaire screen 1000 in FIG. 10 is a screen that changes when the medical questionnaire button 405 is selected. Specifically, after the user sets a document on an ADF (Auto Document Feeder) (not shown) or the like, by selecting the medical questionnaire 405 button on the home screen 400, the document is read based on the settings of the medical questionnaire button 405. Read images and generate image data. After character recognition processing is performed on the generated image data, the medical questionnaire screen 1000 is displayed on the operation unit 205.

The base destination information display box 1001 displays the base destination (host name) set in the medical questionnaire button 405. In the case of the medical questionnaire button 405 of this embodiment, "\\file server\questionnaire" is displayed. The user cannot change the base destination on the medical questionnaire screen 1000.

The destination display box 1002 is a box in which a destination input or selected by the user is displayed as a character string. The string displayed updates as the user inputs and selects. The character string displayed in the destination display box 1002 is stored in the RAM 203 as the destination folder name.

A preview image 1003 is obtained by converting image data generated by reading an image of a document into a RAW image for display.

The text object list 1004 is a list of text objects showing one character string per line (indicating the period from "Date of Consultation" to "March 1, 1990"). A text object is a button that displays a string of characters. As a result of character recognition processing, characters with close spacing are interpreted as one character string, and that character string is displayed as a text object. A method for generating a text object will be explained with reference to FIG. In this way, the characters displayed in the text object through character recognition processing may include numbers. Further, the character string indicated by the text object displayed at this time is stored in the RAM 203 in association with the coordinates on the image of the document. The user can select any text object from the text object list 1004. The character string indicated by the selected text object is set as the name of the folder one level below the folder path displayed in the base destination information display box 1001, and the character string indicated by the selected text object is set as the name of the folder one level below the folder path displayed in the base destination information display box 1001. will be displayed. For example, when the user selects a text object 1005 indicating a character string representing a patient ID of "123", the medical questionnaire screen 1000 is displayed as the medical questionnaire screen 1100 in FIG. 11.

FIG. 11 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan. On the medical questionnaire screen 1100, the selected character string (“123”) is displayed in the destination display box 1002. Furthermore, an area indicated by the coordinate information associated with the character string indicated by the selected text object is highlighted on the preview image 1003 like an area 1101. Furthermore, the character strings in the character string list 1004 are highlighted as highlighted 1102 to indicate that they have been selected.

When the selected character string is selected again or a cancel button 1603, which will be described later, is selected, the display of the character string and each highlighted display in the destination display box 1002 are canceled.

Note that although this embodiment assumes a method in which the user taps a text object as a selection operation, a method such as dragging and dropping the text object onto the destination display box 602 may also be used.

In addition, if the medical questionnaire button 405 is selected and a one-touch transmission scan has been executed in the past, the text object is set to a selected state using the previous input history stored in the storage 204, and the text object is automatically displayed in the destination display box 1002. It is also possible to display the Saving and using the input history will be described in detail in the explanation of FIG. 20, which will be described later.

The scroll bar 1103 is used to check and select text objects that are not completely displayed on the medical questionnaire screen 1100.

The delimiter button 1104 is a button for adding a delimiter for the folder path to the destination display box 1002. When the delimiter button 704 is selected in the state shown in FIG. 7, a delimiter "\" is added to the destination display box 1002, as shown in the medical questionnaire screen 1200 in FIG. Delimiters can be used any number of times, but they cannot be used consecutively without strings appearing between the delimiters. If they are selected consecutively, a warning screen (not shown) will be displayed to the effect that delimiters cannot be consecutive.

FIG. 13 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan. A medical questionnaire screen 1300 in FIG. 13 is a screen that is displayed when two types of text objects are selected.

When two text objects are selected, the character strings indicated by the text objects are displayed in the destination display box 1002 in the order in which they were selected, as in the medical questionnaire screen 1300. The medical questionnaire screen 1300 shows an example in which a text object indicating "123" is selected, and then a text object indicating "otolaryngology" is selected. Further, even when two or more text objects are selected, the same processing as above is performed. That is, when a character (text object) is selected multiple times, a folder path based on a combination of the selected characters is displayed in the destination information box 1002.

Note that if the delimiter button 1104 is not selected and two or more text objects are selected, the selected character strings can be combined to form a single folder name, or the characters that are already selected and displayed can be combined. You can also delete columns and replace them. Additionally, if the delimiter button 1104 is not selected and two or more text objects are selected, a delimiter is automatically added between the characters indicated by the text objects, and the characters of the subsequently selected text objects are added. may be used as the name of a folder in the lower hierarchy.

Furthermore, even if multiple text objects are selected, each highlighting is performed in the same way.

The date button 1301 is a button for adding a character string representing the date of selection to the destination display box 1002. When the date button 1301 is selected on the medical questionnaire screen 1300, a screen like the medical questionnaire screen 1400 in FIG. 14 is displayed.

FIG. 14 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan.

A popup 1401 is a popup for specifying the format of a character string indicating a date (indicating from yyyymmdd to mm-dd-yyyy). When the user selects a date format from the list shown in the pop-up 1401, a character string indicating the date expressed in the selected format is additionally displayed in the destination display box 1002. On the medical questionnaire screen 1400, a text object 1402 of "yyyy-mm-dd" is selected.

Here, an example in which a character string indicating the date is additionally displayed is shown in FIG. FIG. 15 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan. Since the text object 1402 "yyyy-mm-dd" is selected on the medical questionnaire screen 1400, the character string "2018-09-05" is additionally displayed after "123\otolaryngology\". At this time, a character string indicating the folder path "123\Otorhinolaryngology\2018-09-05" to which the character string "2018-09-05" has been added is stored in the RAM 203.

Since the date button 1301 can be used any number of times, the date button 1301 does not change to a selected display.

In this example, since the date is often used as a folder name or file name, a dedicated button is provided to accept input, but if there is a string that is often used in addition to the date, In addition to the button 1301, a dedicated button for the time and the like may be provided.

The extension button 1501 is a button for adding a character string representing an extension to the characters representing the name of the lowest folder of the folder path displayed in the destination display box 1002. When the extension button 1501 is selected on the medical questionnaire screen 1500, a screen like the medical questionnaire screen 1600 in FIG. 16 is displayed.

FIG. 16 is a diagram showing an example of a screen displayed when executing a one-touch transmission scan. In the destination display box 1002 of the medical questionnaire screen 1600, a file path in which ".pdf" is added to "123\Otorhinolaryngology\2018-09-05" is displayed. Here, an extension is added based on the file format set in pulldown 611.

When the extension button is selected and a character string indicating the extension is added to the destination display box, it is highlighted as shown in highlighted display 1601. If you want to cancel selection, you can do so using the same method as the method for canceling selection for text objects described above. Further, if an attempt is made to add a new character string with the extension button 1601 already selected, a warning screen (not shown) is displayed to the effect that an extension has already been input.

The character delete button 1602 is a button for deleting the last character of the character string displayed in the destination display box 1002. For example, when the character delete button 1602 is selected in the state shown in FIG. 16, the character string displayed in the destination display box 1002 is "123\otolaryngology\2018-09-05.pd." Note that one character of the character string stored in the RAM 203 as a folder path is also deleted.

The cancel button 1603 is a button for erasing the most recently input character string when selected. If the previous input method was "select an object from the text object list 1004" or "select the extension button 1501", the highlighted display and selection on the preview image 1003 are also canceled. For example, when the cancel button 1603 is selected in the state shown in FIG. 16, the character string displayed in the destination display box 1002 is "123\otolaryngology\2018-09-05". When selected again, the character string displayed in the destination display box 1002 becomes "123\Otorhinolaryngology\".

When the confirm button 1604 is selected, it combines the character string of the base destination and the character string displayed on the destination display box 1002, sets the folder indicated by the combined character string as the destination, and saves the image data. This is a button to start sending.

The page forward button 1605 is a button that, when selected, displays a preview image to be displayed on the medical questionnaire screen 1600 and an image of another page of the manuscript from which the text object list has been read.

As described above, the user can easily specify destinations across multiple hierarchies simply by selecting objects or buttons, without manually inputting character strings using a keyboard or the like.

FIG. 17 is a flowchart for implementing the processes described in FIGS. 10 to 16, and is a flowchart showing an example of the flow when the one-touch transmission button for file transmission is selected. The processing of the flowchart in FIG. 17 is realized by the CPU 201 reading out the program stored in the ROM 202 into the RAM 203 and executing it. The flow in FIG. 17 is started when the MFP 101 is powered on.

In S1701, the CPU 201 determines whether the one-touch transmission button has been selected. If it is determined that the item has been selected, the process advances to S1702. If not, the process returns to S1701. Here, a case will be described in which the medical questionnaire button 405 is selected as the one-touch transmission button.

In S1702, the CPU 201 reads the reading settings corresponding to the medical questionnaire button 405 set on the settings editing screen 600 from the storage 204.

In step S1703, the CPU 201 controls the scanner to read the image of the document and generate image data based on the reading settings read out in step S1402.

In S1704, the CPU 201 executes character recognition processing using the generated image data. Details of the character recognition process will be described later with reference to FIG.

FIG. 18 is a flowchart showing an example of character recognition processing. The processing of the flowchart in FIG. 18 is realized by the CPU 201 reading out the program stored in the ROM 202 into the RAM 203 and executing it.

In S1801, the CPU 201 generates binary image data using the image data generated in S1703. The generated binary image data is stored in the RAM 203.

In S1802, the CPU 201 lowers the resolution of the binary image data generated in S1801. By lowering the resolution, it is possible to reduce the processing load of searching for character areas from binary image data.

In S1803, the CPU 201 searches for a character area in the image indicated by the low-resolution binary image data. Here, the range to be searched for the character area may be the entire area of the image data, or may be an area set by the user.

In S1804, the CPU 201 executes character cutting processing on the area determined to be a character area in S1803. The character cutting process is a process of cutting out the circumscribed rectangle of each character as a character cutting rectangle based on horizontal and vertical projections. This character cutting process is executed for all areas determined to be character areas.

In S1805, the CPU 201 compares each character cutting rectangle with the dictionary data stored in the ROM 202, and obtains the character code of the most similar character and the coordinate information of the character cutting rectangle. This dictionary comparison process is executed for all character cutting rectangles. Further, in this process, in addition to character codes and coordinate information, font information and the like may also be acquired.

In S1806, the CPU 201 stores the character code and coordinate information, which are the character information acquired in S1805, in the RAM 203.

Here, the explanation returns to the flow of FIG. 17. In S1705, the CPU 201 generates a text object using the character information. The process of generating a text object will be explained in detail with reference to FIG.

FIG. 19 is a flowchart showing an example of a flow in which the MFP 101 generates a text object. The processing of the flowchart in FIG. 19 is realized by the CPU 201 reading out the program stored in the ROM 202 into the RAM 203 and executing it. The flow in FIG. 19 starts when character recognition processing for one page is completed in S1704.

In S1901, the CPU 201 acquires the character information stored in S1806. In S1902, the CPU 201 targets a character cutting rectangle at the top left coordinates of the image indicated by the image data, and determines whether there is a character (character cutting rectangle) to the right of the character cutting rectangle. If it is determined that there is, the process advances to S1903. If not, the process advances to S1904.

In S1903, the CPU 201 determines whether the distance to the character on the right (character cutting rectangle) is less than or equal to a threshold value. If it is determined that it is less than or equal to the threshold, the process advances to S1907. If it is determined that it is larger than the threshold, the process advances to S1904.

In S1907, the CPU 201 generates a combination character string of the target character and the character to its right. Thereafter, the character on the right is selected as the target character, and the process returns to S1902.

In S1904, the CPU 201 stores one or a combination of character strings in the RAM 203 as one character string used for the text object.

In S1905, the CPU 201 generates a text object using the character string stored in the RAM 203 in S1904. Here, the text object is a button on which a character string is displayed.

In S1906, the CPU 201 determines whether all character information has been confirmed. If it is determined that the information has been confirmed, the process ends. If not, the process advances to S1908.

In S1908, the CPU 201 selects the next character as the target, and returns to S1602. Note that when returning to S1902, the character on the right is selected as the next character, but after confirming the rightmost character, the leftmost character in the line immediately below is selected as the next character.

Here, the explanation returns to the flow of FIG. 17. In S1706, it is determined whether the page on which character recognition processing and text object generation were performed is the last page of the images read in S1703. If it is determined that the page is the last page, the process advances to S1707. If not, the next page is targeted and the process returns to S1704.

In S1707, the CPU 201 displays a screen for selecting a text object. The screen displayed here is the one shown in FIG. 10. Note that even if the destination information box on the screen displayed here automatically displays a character string indicating the folder path based on the coordinate information, delimiter, and extension information stored in S1711, which will be described later. good. For example, if the text object "123" in Figure 10 was selected in the previous process and the transmission process was executed, character recognition processing is executed in the area indicated by the coordinate information of "123" and the recognized character string is It is displayed in the destination information box 1002. Furthermore, if a delimiter or extension was selected last time, its presence or absence and insertion location are memorized. ” followed by the extension).

In S1708, the CPU 201 determines whether the confirm button has been selected. If it is determined that the item has been selected, the process advances to S1710. If not, the process advances to S1709.

In S1709, the CPU 201 executes character string processing. Details of character string processing will be explained with reference to FIG.

FIG. 20 is a flowchart showing an example of the flow of character string processing. The processing of the flowchart in FIG. 20 is realized by the CPU 201 reading the program stored in the ROM 202 into the RAM 203 and executing it. The flow in FIG. 20 is started when it is determined in S1708 that the OK button has not been selected.

In S2001, the CPU 201 determines whether the character erase button 1602 has been selected. If it is determined that the item has been selected, the process advances to S2002. If not, the process advances to S2010.

In S2002, the CPU 201 deletes the last character of the character string displayed in the destination information box. Further, the same processing is performed for characters stored in the RAM 203. Then, the process ends.

In S2010, the CPU 201 determines whether the character cancel button 1603 has been selected. If it is determined that the item has been selected, the process advances to S2011. If not, the process advances to S2020.

In S2011, the CPU 201 deletes one character string displayed in the destination information box. You can also remove delimiters and extensions. Further, similar processing is performed for character strings stored in the RAM 203.

In S2012, the CPU 201 deletes the coordinate information, presence/absence of delimiters, and extension information stored in the storage 204 as input history in accordance with the character string deleted in S2011. Then, the process ends.

In S2020, the CPU 201 determines whether a text object is selected from the text object list and whether an extension button is selected. If a text object or an extension button is selected, the process advances to S2021. If the text object is not selected or the extension button is not selected, the process advances to S2030.

In S2021, the CPU 201 determines whether the selected object has already been selected. That is, it is determined whether the selected text object has already been selected. The CPU 201 also determines whether the selected extension button has been selected. If it is determined that the text object or extension button has been selected, the process advances to S2022. If it is determined that the text object or extension button has not been selected, the process advances to S2024.

In S2022, the CPU 201 deletes the character string corresponding to the selected text object or extension button from the destination information box. Further, the character strings stored in the RAM 203 are also deleted in the same manner.

In S2023, the CPU 201 deletes the coordinate information and extension information stored in the storage 204 as input history in accordance with the character string deleted in S2022. Then, the process ends.

In S2024, the CPU 201 determines whether the sum of the length of the character string displayed in the destination display box and the length of the character string selected by the user is less than or equal to the maximum length, and whether the extension button has been selected. . If it is determined that the sum of the lengths of the character strings is less than or equal to the maximum length and the extension button is not selected, the process advances to S2025. If not, the process advances to S2027. Here, the maximum length may be determined based on the implementation constraints of the MFP 101 and the file path constraints of the file server 102, or may be set by the user.

In S2025, the CPU 201 selects the character string corresponding to the selected text object, the extension if the extension button is selected, the delimiter if the delimiter button is selected, and the character string displayed in the destination information box. Combine and display at the back. Further, the character string is similarly stored in the RAM 203 by being connected to the end of the character string stored at that time.

In S2026, the CPU 201 stores the input history corresponding to the character string added in S2025 in the storage 204.

In S2027, since the user's selection violates any of the constraints of maximum length, delimiter, and extension, the CPU 201 displays a warning screen (not shown) according to the conflicting constraint. In this embodiment, the method for ending the display of the warning screen assumes a tap operation by the user, but it may be implemented so that it ends automatically after a predetermined period of time (for example, 1 second) has elapsed.

In S2030, the CPU 201 determines whether the delimiter button has been selected. If it is determined that the item has been selected, the process advances to S2031. If not, the process advances to S2040.

In S2031, the CPU 201 determines whether delimiters are selected consecutively. If it is determined that they have been selected consecutively, the process advances to S2027. If not, the process advances to S2032.

In S2032, the CPU 201 determines whether the sum of the length of the character string displayed in the destination display box and the length of the character string selected by the user is less than or equal to the maximum length, and whether the extension button has been selected. . If it is determined that the sum of the lengths of the character strings is less than or equal to the maximum length and the extension button is not selected, the process advances to S2025. If not, the process advances to S2027.

In S2040, the CPU 201 determines whether the page forward button has been selected by the user. If it is determined that the item has been selected, the process advances to S2041. If not, the date button is selected, so the process advances to S2050.

In S2041, the CPU 201 displays a preview image to be displayed on the medical questionnaire screen and an image of another page of the manuscript from which the text object list has been read. By selecting the button on the right, the next page after the currently displayed page is displayed, and when the button on the left is selected, the page before the currently displayed page is displayed. be done. Then, the process ends.

In S2050, the CPU 201 determines whether the sum of the length of the character string displayed in the destination display box and the length of the character string selected by the user is less than or equal to the maximum length, and whether the extension button has been selected. . If it is determined that the sum of the lengths of the character strings is less than or equal to the maximum length and the extension button is not selected, the process advances to S2051. If not, the process advances to S2053.

In S2051, since the date button 1301 and pop-up 1401 are selected, the CPU 201 combines and displays the selected date after the character string displayed in the destination information box, according to the selected date format. . Also, in the RAM 203, the character string is similarly stored after being combined with the character string stored at that time.

In S2052, the CPU 201 stores the input history corresponding to the character string added in S2051 in the storage 204.

In S2053, the CPU 201 executes the same process as S2027.

Here, the explanation returns to the flow of FIG. 17. In S1710, the CPU 201 acquires the host name (folder path) displayed in the base destination information box and stores it in the RAM 203. In the case of FIG. 16, it is "\\file server\questionnaire."

In S1711, the CPU 201 combines the folder path acquired in S1711 with the character string stored in the RAM 203 in S1709, and sets the folder path as the destination of the image data generated in S1703. In the case of FIG. 16, it is "\\file server\medical interview form\123\otolaryngology\2018-09-05.pdf". In this case, "2018-09-05.pdf" is set as the file name, and the file is sent to "¥¥File Server¥Question Form¥123¥Otorhinolaryngology" with the file name "2018-09-05.pdf." Note that if a file name is not set, the date, time, etc. may be automatically assigned as the file name.

In S1712, the CPU 201 transmits the file generated by converting the image data into a file to the destination set in S1711.

By performing the above processing, it is possible to reduce the user's effort when setting a folder path consisting of multiple layers of a folder to which image data is to be transmitted.

Note that in this embodiment, when the one-touch transmission button is selected, the image of the document is read, image data is generated, and character recognition processing and text object generation processing are executed, but the present invention is not limited to this. For example, the MFP 101 may receive image data transmitted from an external device, perform character recognition processing and text object generation processing on the image data, and display a screen as shown in FIG. 10. Further, when the scan button 402 is selected, an image of the document may be read to generate image data, and character recognition processing and text object generation processing may be executed.

In the present embodiment, an example has been described in which a setting screen such as the button setting editing screen 600 is displayed on the display device 311 connected to the PC 104 connected via HTTP, but the present invention is not limited to this. For example, a settings screen such as the button settings edit screen 600 may be displayed on the touch panel 410 on the operation unit 205 of the MFP 101, and operations may be accepted.

<Other embodiments>
Note that the object of the present invention is achieved by performing the following processing. That is, a storage medium recording a program code that implements the functions of the embodiments described above is supplied to a system or device, and the computer (or CPU, MPU, etc.) of the system or device reads the program code stored in the storage medium. This is the process of reading out the . In this case, the program code read from the storage medium itself realizes the functions of the embodiments described above, and the program code constitutes the present invention.

Furthermore, the present invention also includes a case where the functions of the above embodiments are realized by executing a program code read by a computer. In addition, based on the instructions of the program code, an OS (operating system) etc. running on the computer performs some or all of the actual processing, and the functions of the embodiments described above are realized by this processing. This also includes cases.

101 MFP
104 PCs
100 LAN
201 CPU
205 Operation section

Claims (24)

an acquisition means for acquiring character information from an image of image data ;
a display means for displaying an image;
While the display means is displaying the first image that is the image of the first image data , specifying the position of the first area and the position of the second area in the first image. A reception means for accepting,
A folder that is an image of second image data and has a folder name that includes a character string indicated by the first character information acquired from the first area of the second image that has the same size as the first image. and for storing a file based on the second image and having a file name including a character string indicated by the second character information acquired from the second area of the second image. An image processing device characterized by having an execution means for executing processing. an acquisition means for acquiring character information from an image;
a display means for displaying an image;
a position of a first area in the first image while the first image is being displayed by the display means; a receiving means for receiving a designation of the location and a designation of the location of the second area;
a region within the second image, the first region being acquired from a region corresponding to the position of the first region; The area in the second image is added to a folder whose name includes the character string indicated by character information No. 1. and the sentence indicated by the second character information acquired from the area corresponding to the position of the second area. A file that has a file name that includes a character string and stores a file that is based on the second image. An image processing apparatus characterized by having an execution means for executing processing to perform processing. further comprising a reading means for reading the image of the document and generating image data,
The first image is the first image generated by the reading means reading the first original. It is an image of the image data of 1,
The second image is the second image generated by the reading means reading the second original. 2. The image processing apparatus according to claim 1, wherein the image is an image of image data of No. 2. further comprising a reading means for reading the image of the document and generating image data,
The first image is an image of image data generated by the reading means reading a first document,
3. The image processing apparatus according to claim 2, wherein the second image is an image of image data generated by the reading means reading a second original. The image processing apparatus according to any one of claims 1 to 4 , wherein the file is transmitted so that the file is stored in the folder by the execution unit executing the process. . 6. The acquisition means acquires the first character information and the second character information from the second image by executing character recognition processing. The image processing device described in . further comprising specifying means for specifying a folder name of a folder in which the file is stored based on the first character information, and specifying a file name of the file based on the second character information,
The image according to any one of claims 1 to 6 , wherein the execution means executes processing for storing the file with the specified file name in the folder with the specified folder name. Processing equipment. 8. The image processing apparatus according to claim 1, wherein the character information includes a character code. an acquisition step of acquiring character information from an image of image data ;
a display step of displaying an image;
A reception desk that accepts designation of the position of a first area in the first image and designation of the position of the second area in the state where the first image, which is the first image data, is being displayed in the display step. process and
A folder that is an image of second image data and has a folder name that includes a character string indicated by the first character information acquired from the first area of the second image that has the same size as the first image. and for storing a file based on the second image and having a file name including a character string indicated by the second character information acquired from the second area of the second image. An image processing method comprising an execution step of executing processing. an acquisition step of acquiring character information from the image;
a display step of displaying an image;
a reception step of receiving designation of a position of a first region and a designation of a second region in the first image while the first image is being displayed in the display step;
The area within the second image is stored in a folder having a folder name that includes a character string indicated by the first character information acquired from an area within the second image that corresponds to the position of the first area. A file having a file name including a character string indicated by second character information obtained from an area corresponding to a position of the second area , the file being based on the second image. An image processing method comprising an execution step of executing processing for storing . further comprising a reading step of reading an image of the document to generate image data,
The first image is the first image generated by reading the first document in the reading step. It is an image of the image data of 1,
The second image is the second image generated by reading the second document in the reading step. 10. The image processing method according to claim 9, wherein the image is the image data of No. 2. further comprising a reading step of reading an image of the document to generate image data,
The first image is an image of image data generated by reading the first document in the reading step,
11. The image processing method according to claim 10 , wherein the second image is an image of image data generated by reading a second document in the reading step. The image processing method according to any one of claims 9 to 12 , wherein the file is transmitted to be stored in the folder by executing the process in the execution step. . Any one of claims 9 to 13, wherein the acquiring step acquires the first character information and the second character information from the second image by executing character recognition processing. Image processing method described in Section . identifying a folder name of a folder in which the file is stored based on the first character information;
further comprising a specifying step of specifying a file name of the file based on the second character information,
The image according to any one of claims 9 to 14 , characterized in that, in the execution step, a process for storing a file with the specified file name in a folder with the specified folder name is executed. Processing method. 16. The image processing method according to claim 9 , wherein the character information includes a character code. an acquisition step of acquiring character information from an image of image data ;
a display step of displaying an image;
While the first image, which is an image of the first image data, is displayed in the display step, specifying the position of the first area and the position of the second area in the first image are performed. The reception process,
A folder that is an image of second image data and has a folder name that includes a character string indicated by the first character information acquired from the first area of the second image that has the same size as the first image. and for storing a file based on the second image and having a file name including a character string indicated by the second character information acquired from the second area of the second image. A program characterized by having an execution step for executing processing. an acquisition step of acquiring character information from the image;
a display step of displaying an image;
the position of the first area in the first image while the first image is being displayed in the display step; a reception step of accepting the designation of the location and the designation of the location of the second area;
a region within the second image, the first region being acquired from a region corresponding to the position of the first region; The area in the second image is added to a folder whose name includes the character string indicated by character information No. 1. and the sentence indicated by the second character information acquired from the area corresponding to the position of the second area. A file that has a file name that includes a character string and stores a file that is based on the second image. A program characterized in that it has an execution step of executing a process for. further comprising a reading step of reading an image of the document to generate image data,
The first image is the first image generated by reading the first document in the reading step. It is an image of the image data of 1,
The second image is the second image generated by reading the second document in the reading step. 18. The program according to claim 17, wherein the program is an image of image data of No. 2. further comprising a reading step of reading an image of the document to generate image data,
The first image is an image of image data generated by reading the first document in the reading step,
19. The program according to claim 18 , wherein the second image is an image of image data generated by reading a second document in the reading step. 21. The program according to claim 17 , wherein the file is transmitted to be stored in the folder by executing the process in the execution step. Any one of claims 17 to 21 , wherein the acquiring step acquires the first character information and the second character information from the second image by executing character recognition processing. The program described in Section . identifying a folder name of a folder in which the file is stored based on the first character information;
further comprising a specifying step of specifying a file name of the file based on the second character information,
The program according to any one of claims 17 to 22 , characterized in that, in the execution step, a process for storing a file with the specified file name in a folder with the specified folder name is executed. . 24. The program according to claim 17 , wherein the character information includes a character code.

Images