JP2009054118A - User interface device, user interface method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To specify various processing objects and processing contents with a simple operation. <P>SOLUTION: This user interface device comprises a display scanner touch panel 111 that displays an image on an image display surface, detects light coming from the outside to the image display surface and creates scan image data, and further detects the position specified from the outside on the image display surface, and a processing determination section that determines the processing to be executed and the processing object data of this processing and commands the determined processing to process the determined processing object data based on the scan image data near the detected position and detected position, of scan image data created by the display scanner touch panel. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a user interface device, a user interface method and a program, and in particular displays an image on an image display surface, detects light incident on the image display surface from the outside, generates scan image data, and further displays the image The present invention relates to a user interface device, a user interface method, and a program using a liquid crystal scanner touch panel that detects a position designated from the outside on a screen.

Conventionally, in an input method using a touch panel, a touch position or a touch action such as a double touch or a slide is detected, and a processing target or processing content is designated according to these or a combination thereof.
For example, Patent Document 1 describes an input device that detects the direction, speed, or length of a slide operation, or detects a slide operation that rotates in a circle. Patent Document 2 describes an input device that inputs a touch action by moving a predetermined length while pressing down on a touch panel. Patent Document 3 describes a graphic processing apparatus that determines whether it is a one-point instruction or a two-point instruction. Further, Patent Document 4 describes an automatic transaction apparatus in which handwriting is determined by character input and security is improved. Patent Document 5 describes an input device that gives an operation instruction by changing the speed and direction of an operation of tracing on a touch panel. Further, Patent Document 6 describes an input method in the case of performing input for position instruction by a touch screen.
Japanese Patent Laying-Open No. 2005-082086 JP-A-11-126132 JP 2001-134382 A JP-A-9-259331 Japanese Patent Laid-Open No. 9-50235 JP-A-5-143235

  However, in the conventional apparatus, the number of processing targets or processing contents that can be instructed is limited to the number of touch action patterns, or in order to cope with various processing targets and processing contents, There is a problem that the operation becomes complicated, such as being complicated or combining a plurality of touch actions.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a user interface device, a user interface method, and a program capable of designating various processing targets and processing contents with a simple operation. There is.

  The present invention has been made to solve the above-described problems, and the user interface device of the present invention displays an image on an image display surface and detects light incident on the image display surface from the outside to scan an image. A display scanner touch panel that generates data and further detects a position indicated from the outside on the image display surface; scan image data in the vicinity of the detected position among the scan image data generated by the display scanner touch panel; and A process determining unit that determines a process to be executed and processing target data of the process based on the detected position and instructs the determined process to process the determined processing target data. .

  Thus, the user interface device determines the processing to be executed and the processing target data according to the combination of the instructed position detected by the display scanner touch panel and the scan image data in the vicinity thereof. Various processing targets and processing contents can be designated by a simple operation of touching once.

  The user interface device of the present invention is the above-described user interface device, wherein the process determining unit determines a process to be executed based on scan image data in the vicinity of the detected position, and sets the detected position at the detected position. Based on this, the processing target data of the processing to be executed is determined.

  A user interface device according to the present invention is the above-described user interface device, and stores data identification information or processing target data for identifying processing target data and information representing an area on the image display surface in association with each other. A coordinate storage unit that stores pattern identification information that identifies scan image data, and process identification information that identifies processing, and an image that represents the processing target data. An image generating unit that displays on the display surface and associates information indicating the area where the image is displayed with processing target data represented by the image or data identification information for identifying the processing target data and stores the information in the coordinate storage unit And the processing determining unit identifies scan image data in the vicinity of the detected position. A process for executing the process represented by the process identification information stored in the pattern storage unit in association with the pattern identification information, and stored in the coordinate storage unit in association with the information representing the area including the detected position. The processing target data or the processing target data represented by the data identification information is set as the processing target data of the processing to be executed.

  Further, the user interface device of the present invention is the above-described user interface device, wherein the process determining unit executes a process to be executed based on scan image data in the vicinity of the detected position and the detected position. And the personal authentication process is performed based on the scanned image data in the vicinity of the detected position.

  Thus, the user interface device determines the process to be executed and the processing target data according to the combination of the instructed position detected by the display scanner touch panel and the scan image data in the vicinity thereof, and the scan image data. Since personal authentication processing is performed based on the above, it is possible to specify various processing targets and processing contents with a simple operation of touching the display scanner touch panel once with a pattern / shape that can identify an individual such as a fingerprint. Personal authentication processing can be performed simultaneously.

  A user interface device according to the present invention is the above-described user interface device, and stores data identification information or processing target data for identifying processing target data and information representing an area on the image display surface in association with each other. An image of the display scanner touch panel, an image representing the processing target data, and a coordinate storage unit for storing the pattern identification information for identifying the scanned image data and the personal identification information for identifying the individual. An image generating unit that displays on the display surface and associates information indicating the area where the image is displayed with processing target data represented by the image or data identification information for identifying the processing target data and stores the information in the coordinate storage unit And the processing determining unit identifies scan image data in the vicinity of the detected position. The personal identification information stored in the pattern storage unit in association with the pattern identification information is read to perform personal authentication, and a process to be executed is determined based on the result of the personal authentication, and an area including the detected position is determined. The processing target data stored in the coordinate storage unit in association with the information to be displayed or the processing target data represented by the data identification information is used as the processing target data for the processing to be executed.

  Further, the user interface device of the present invention is any one of the above-described user interface devices, and corresponds to data identification information or processing target data for identifying processing target data and information representing an area on the image display surface. A coordinate storage unit for storing information, pattern identification information for identifying scanned image data, personal identification information for identifying an individual, and processing identification information for identifying a process in association with each other, and the process The image representing the target data is displayed on the image display surface of the display scanner touch panel, and the information representing the area where the image is displayed corresponds to the processing target data represented by the image or the data identification information for identifying the processing target data And an image generation unit to be stored in the coordinate storage unit, and the processing determination unit detects the detection The personal identification information stored in the pattern storage unit in association with the pattern identification information for identifying the scan image data in the vicinity of the position is read and personal authentication is performed, and the pattern identification information and the personal identification information are supported. In addition, the process identification information stored in the pattern storage unit is read out, the process identified by the read process identification information is executed, and the coordinate storage is associated with the information representing the area including the detected position. The processing target data stored in the section or the processing target data represented by the data identification information is used as the processing target data for the process to be executed.

  A user interface device according to the present invention is any one of the above-described user interface devices, and includes a fingerprint feature information extraction unit that extracts fingerprint feature information from the scanned image data, and the processing determination unit includes: It is determined based on the feature information extracted by the fingerprint feature information extraction unit from the scanned image data.

The user interface device of the present invention displays an image on the image display surface, detects light incident on the image display surface from the outside, generates scan image data, and further instructs the image display surface from the outside. In the scan image data generated by the display scanner touch panel that detects the detected position, the process to be executed and the processing target data of the process are determined based on the scan image data in the vicinity of the detected position and the detected position. And a process determining unit for instructing the determined process to process the determined data to be processed.

  Further, the user interface method of the present invention displays an image on an image display surface, detects light incident on the image display surface from the outside, generates scan image data, and further instructs the image display surface from the outside. A user interface method in a user interface device including a display scanner touch panel for detecting a position that has been detected, wherein the display scanner touch panel detects light incident from the outside on an image display surface and generates scan image data A first step of detecting a position designated from the outside on the image display surface, and the user interface device detects in the first step of the scan image data generated in the first step. Based on scanned image data in the vicinity of the detected position and the detected position. A second process for determining a process to be executed and processing target data for the process, and a process target determined in the second process by the user interface device in the process determined in the second process And a third process for instructing data processing.

  The program of the present invention displays an image on the image display surface, detects light incident on the image display surface from outside, generates scan image data, and is further instructed from the outside on the image display surface. A computer of a user interface device including a display scanner touch panel for detecting a position is executed based on scan image data in the vicinity of the detected position and the detected position among scan image data generated by the display scanner touch panel. The processing to be performed and the processing target data of the processing are determined, and the determined processing is caused to function as a processing determination unit that instructs the processing of the determined processing target data.

  According to the present invention, since the process to be executed and the processing target of the process are determined based on the scanned image data generated by the display scanner touch panel and the detected designated position, various processing targets and processes can be performed with a simple operation. You can specify the content.

[First Embodiment]
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a hardware configuration of a document management apparatus 100 according to the first embodiment of the present invention. The document management apparatus 100 according to this embodiment displays a list of stored documents, and the user presses a stamp designating any one of approval, rejection, and deletion with respect to the document in the list. Is a device that performs either registration of approval, registration of rejection, or deletion of the document in the pressed document, and includes a control unit 101, a memory 102, an input / output unit 103, and a liquid crystal scanner touch panel unit. 110 and a bus 104 that connects these units. The control unit 101 controls the entire document management apparatus 100. The memory 102 includes a RAM (Random Access Memory) that is a readable / writable memory, a ROM (Read Only Memory) that is a readable memory, and a readable / writable nonvolatile memory such as a hard disk. The ROM stores a program for operating the control unit 101. The input / output unit 103 inputs / outputs document data managed by the document management apparatus 100.

  FIG. 2 is a schematic block diagram showing a functional configuration of the document management apparatus 100 according to the present embodiment. The document management apparatus 100 includes a user interface unit 110, a document display processing unit 120, an approval processing unit 130, a rejection processing unit 140, a deletion processing unit 150, and a document storage unit 160. Further, as will be described later, the user interface unit 110 includes a liquid crystal scanner touch panel unit 111, a two-dimensional barcode decoding unit 112, an image generation unit 114, a processing determination unit 113, a coordinate storage unit 115, and a pattern storage unit 116. .

  The user interface unit (user interface device) 110 displays a document list screen and a document screen on the liquid crystal display of the liquid crystal scanner touch panel unit 111, and when the document list screen is pressed with a stamp to be described later, Based on the scanned image data obtained by reading the stamp face of the pressed stamp, which of the document display processing unit 120, the approval processing unit 130, the rejection processing unit 140, and the deletion processing unit 150 processes which document is to be processed. decide. The document display processing unit 120 displays the designated document data on the document screen. The approval processing unit 130 registers “approval” in the document storage unit 160 in association with the designated document data. The rejection processing unit 140 registers “rejection” in the document storage unit 160 in association with the designated document data. The deletion processing unit 150 deletes the designated document data from the document storage unit 160. The document storage unit 160 stores document identification information for identifying document data, document data approval status, and document data in association with each other.

  As described above, the user interface unit 110 includes the liquid crystal scanner touch panel unit 111, the image generation unit 114, the process determination unit 113, the coordinate storage unit 115, and the pattern storage unit 116. A liquid crystal scanner touch panel unit (display scanner touch panel) 111 includes a glass plate P1 having a light sensor element LS1 made of a low-temperature CG silicon crystal or the like on a surface thereof, as schematically shown in FIG. It has a liquid crystal display comprising a glass plate P2 and a liquid crystal L1 sandwiched between the glass plate P1 and the glass plate P2. The liquid crystal display of the liquid crystal scanner touch panel unit 111 displays the image generated by the image generation unit 114 by controlling the transmittance of light emitted from the backlight with the liquid crystal L1, and in the vicinity of the display surface. Light that is incident on the liquid crystal display from the outside, such as light reflected from the light emitted from the backlight of the liquid crystal display by an object that is placed or in contact with the display surface (finger in FIG. 3) is applied to the optical sensor element LS1. By detecting this, the image display area of the liquid crystal display is scanned to generate scan image data. Further, the liquid crystal scanner touch panel unit 111 detects a position designated from the outside by the liquid crystal display. The liquid crystal scanner touch panel unit 111 may detect a position indicated by affixing a touch pad on the surface of the glass plate P1 in FIG. 4 and detecting a position touched by the touch pad. The movement of the elongated shape may be detected from the scan image data, and the position of the tip of the shape when the movement of the shape stops for a certain time may be detected as the designated position.

  The two-dimensional barcode decoding unit performs a two-dimensional barcode decoding process on the two-dimensional barcode image, and generates a character string as a decoding process result. The image generation unit 114 selects unapproved document data from the document storage unit 160, a document list screen in which icons representing the selected document data are arranged, and a document display for displaying the document selected on the document list screen A screen is generated and displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111. At this time, the image generation unit 114 associates the upper left and lower right coordinates of each icon with the upper left corner of the screen as the origin and the document identification information of the document data represented by the icon in the coordinate storage unit 115. Remember. In addition, the image generation unit 114 performs an approval process, a rejection process, and a deletion process, generates a screen for notifying the user of the processing result, and displays the screen on the liquid crystal display of the liquid crystal scanner touch panel unit 111.

The process determining unit 113 obtains position information of the position detected by the liquid crystal scanner touch panel unit 111 and scan image data in the vicinity of the position, for example, scan image data of a square area of 50 pixels in length and width around the position. Based on the decoding process result obtained by reading the scanned image data read from the liquid crystal scanner touch panel unit 111 and the two-dimensional barcode decoding unit 112 with reference to the pattern storage unit 116, an approval process, a rejection process, a deletion process, and a document display are performed. A process to be executed is determined from the processes, and based on the position information read from the liquid crystal scanner touch panel unit 111, document data as processing target data of the process to be executed determined with reference to the coordinate storage unit 115 is determined.
The coordinate storage unit 115 stores the document identification information and the coordinate information indicating the area where the icon of the document is displayed on the document list screen in association with each other.
The pattern storage unit 116 stores pattern identification information for identifying scanned image data and processing identification information for processing corresponding to the scanned image data in association with each other.

  In the present embodiment, the two-dimensional barcode decoding unit 112, the processing determination unit 113, the image generation unit 114, the document display processing unit 120, the approval processing unit 130, the rejection processing unit 140, and the deletion processing unit 150 illustrated in FIG. The control unit 101 reads and executes a program stored in the memory 102 to perform processing of each unit. The coordinate storage unit 115, the pattern storage unit 116, and the document storage unit 160 are included in the memory 102, and information stored in these units is stored in the RAM of the memory 102 or a nonvolatile memory.

  FIG. 4 is a diagram illustrating an example of the document list screen G1 and the document display screen D1 that the document management apparatus 100 displays on the liquid crystal display of the liquid crystal scanner touch panel unit 111. Like the document list screen G1 and the document display screen D1 shown in FIG. 4, in the document list screen according to the present embodiment, icons representing unapproved document data are enumerated as icons IC1 and IC2. The document display screen in this embodiment displays the content of the document corresponding to the icon selected on the document list screen. A user who has the document approval right presses the approval stamp S1 for the icon of the document data to be approved, presses the rejection stamp S2 for the icon of the document data to be rejected, and presses the deletion stamp S3 for the icon of the document data to be deleted. Then, the document management apparatus 100 performs processing corresponding to the stamp face of the stamp that has been stamped on the document data. When an icon is pressed with another object such as a finger, the document management apparatus 100 displays the content of the document corresponding to the icon on the document screen. Here, two-dimensional bar codes in which different character strings are encoded are drawn on the surfaces of the approval stamp S1, the rejection stamp S2, and the deletion stamp S3. The document management apparatus 100 can determine which stamp is the stamp that has been pressed by reading and decoding these two-dimensional barcodes to obtain a character string.

  FIG. 5 is a diagram illustrating an example of the contents stored in the pattern storage unit 116. As illustrated in FIG. 5, the pattern storage unit 116 includes pattern identification information “decoding information of the stamp of the approval stamp S 1” and processing identification information “approval”, pattern identification information “decoding information of the stamp of the rejection stamp S 2” and processing. Pattern identification information and process identification information are stored in association with each other, such as identification information “denied”, pattern identification information “decoding information on the face of the deletion stamp S3”, and process identification information “deletion”. Here, the “decoding information of the stamp of the approval stamp S1”, “decoding information of the stamp of the rejection stamp S2”, and “decoding information of the stamp of the deletion stamp S3” cited as the pattern identification information are displayed on the stamp of each stamp. It represents a character string obtained by decoding the drawn two-dimensional barcode.

  FIG. 6 is a diagram illustrating an example of stored contents of the coordinate storage unit 115. The coordinate storage unit 115 includes coordinate information “20, 30, 120, 130”, document identification information “070423RREQ”, coordinate information “20, 180, 120, 280”, and document identification information “070420SREQ” illustrated in FIG. As described above, coordinate information and document identification information are stored in association with each other. Here, the coordinate information is a number representing the upper left coordinate and the lower right coordinate of the rectangular area where the icon of the associated document identification information is displayed, and the coordinate information “20, 30, 120, 130”. ”Is a rectangle whose diagonal is a line connecting the X coordinate“ 20 ”, Y coordinate“ 30 ”point and the X coordinate“ 120 ”, Y coordinate“ 130 ”point with the upper left corner of the screen as the origin. Represents the area. The area represented by the coordinate information is an area where an icon is displayed, and if the position where the stamp is pressed is within the area, the document data of the document identification information associated with the coordinate information is processed. It is also the area that becomes the target data.

  FIG. 7 is a diagram illustrating an example of stored contents of the document storage unit 160. In the document storage unit 160, the document identification information “070423RREQ”, the approval state “unapproved”, the document data “070423RREQ.TXT”, the document identification information “070420SREQ”, the approval state “approved”, and the document data illustrated in FIG. As in “070420SREQ.TXT”, document identification information, an approval state, and document data are stored in association with each other. Here, there are three types of approval states: “unapproved” that has not yet been approved or rejected, “approved” that has been approved, and “denied” that has been rejected. A character string stored as document data such as document data “070423RREQ.TXT” is a file name storing the document data, and the file storing unit 160 also stores a file having the file name storing the actual document data. I remember it.

  FIG. 8 is a flowchart for explaining the operation of the document management apparatus 100. First, the image generation unit 114 of the document management apparatus 100 selects document data whose approval status is “unapproved” from the document storage unit 160, and generates a document list screen in which icons representing the selected document data are arranged. Then, it is displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sa1). At this time, the image generation unit 114 stores the upper left and lower right coordinates of each icon in association with the document identification information of the document data represented by the icon in the coordinate storage unit 115. Here, it is assumed that the user presses the approval stamp S1 on one of the icons displayed on the document list screen. The process determining unit 113 displays position information (for example, coordinates on the screen such as “82, 93”) indicating the coordinates where the approval stamp S1 is pressed, and the stamp surface read when the approval stamp S1 is pressed. Scanned image data is read from the liquid crystal scanner touch panel unit 111 (Sa2). The process determining unit 113 outputs the scanned image data read in step Sa2 to the two-dimensional barcode decoding unit 112, and the two-dimensional barcode decoding unit 112 adds the two-dimensional barcode to the received scanned image data. The decryption process is performed (Sa3), and the character string of the decryption process result is output to the process determination unit 113. Next, the process determining unit 113 searches for pattern identification information in the pattern storage unit 116 using this character string as a key (Sa4).

  Next, the process determining unit 113 determines whether there is matching pattern identification information as a result of the search in step Sa4 (Sa5). If it is determined in step Sa5 that there is no matching pattern identification information, the process proceeds to step Sa6, and the coordinate storage unit 115 is searched for coordinate information representing an area including the coordinates represented by the position information read in step Sa2. To do. Next, the document display processing unit 120 reads out the document identification information stored in the coordinate storage unit 115 in association with the coordinate information searched in step Sa6, and further stores the document storage unit in association with the document identification information. Read stored document data. The image generation unit 114 generates a document display screen for displaying the contents of the read document data, displays the document display screen on the liquid crystal display of the liquid crystal scanner touch panel unit 111, and ends the process.

Here, if the approval stamp S1 is pressed as described above, it is determined in step Sa5 that there is matching pattern identification information, so the process decision unit 113 proceeds to step Sa8, The coordinate storage unit 115 is searched for coordinate information representing an area including the coordinates represented by the position information read in Sa2.
Here, whether or not the coordinates of the position information are included in the area represented by the coordinate information is determined as follows. That is, the coordinate information is “X1, Y1, X2, Y2” in which the upper left XY coordinate value and the lower right XY coordinate value are arranged, and the position information coordinates are “x, y”. When the two inequalities X1 ≦ x ≦ X2 and Y1 ≦ y ≦ Y2 are satisfied, the region represented by the coordinate information includes the coordinates of the position information. If any one of the inequalities is not satisfied, the coordinate information is It is determined that the position information does not include the coordinates of the position information.

  Next, the process determining unit 113 reads the process identification information stored in the pattern storage unit 116 in association with the pattern identification information searched in step Sa4, and whether or not the read process identification information is “approval”. Is determined (Sa9). When it is determined as “approved” in step Sa9, the process determining unit 113 reads out the document identification information stored in the coordinate storage unit 115 in association with the coordinate information searched in step Sa8. By outputting the document identification information to the approval processing unit 130 that performs processing represented by “approval”, the approval processing unit 130 is instructed to process the document data of the document identification information. The approval processing unit 130 searches the document storage unit 160 using the received document identification information as a key, and registers “approval” as the approval state of the corresponding document data (Sa10). An approval screen for notifying the user that the image generation unit 114 has approved is generated, displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sa11), and the process is terminated.

  On the other hand, when it is determined in step Sa9 that the process identification information is not “approved”, the process transitions to step Sa12, and the process determination unit 113 determines whether or not the process identification information is “denied”. Is determined (Sa12). When it is determined as “No” in the determination at Step Sa12, the process determining unit 113 reads out the document identification information stored in the coordinate storage unit 115 in association with the coordinate information searched at Step Sa8, By outputting the document identification information to the rejection processing unit 140 that performs the process indicated by “rejection”, the document processing unit 140 instructs the rejection processing unit 140 to process the document data of the document identification information. The rejection processing unit 140 searches the document storage unit 160 using the received document identification information as a key, and registers “rejection” in the approval state of the corresponding document data (Sa13). A rejection screen for notifying the user that the image generation unit 114 has rejected is generated and displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sa14), and the process is terminated.

  If it is determined in step Sa12 that the above-described process identification information is not “decision”, the process proceeds to step Sa15, and the process determination unit 113 stores the coordinate information in association with the coordinate information searched in step Sa8. The document identification information stored in the unit 115 is read out, and the document identification information is output to the deletion processing unit 150 that performs the process represented by “deletion”, whereby the processing of the document data of the document identification information is deleted. To instruct. The deletion processing unit 150 searches the document storage unit 160 using the received document identification information as a key, and deletes the corresponding document data and items associated with the document data from the document storage unit 160 (Sa15). A deletion screen for notifying the user that the image generation unit 114 has deleted is generated, displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sa16), and the process is terminated.

In addition, before step Sa15, a step for determining whether or not “delete” is inserted, and when it is determined that “delete”, the process proceeds to step Sa15. If it is neither “denied” nor “deleted”, the process may proceed to step Sa6.
In this embodiment, there are only four types of processing contents: approval, rejection, deletion, and document display. However, the number of stamps is increased, and other processing identification information is obtained by using the decoding information of the stamp face of each stamp as pattern identification information. And may be stored in the pattern storage unit 116 so that more types of processing contents can be instructed.

  In this way, the process in which the liquid crystal scanner touch panel unit 111 acquires the position where the stamp is pressed and the scan image data of the stamp face, and the process determination unit 113 executes based on the scan image data of the stamp is the process of the process. The target data is determined based on the pressed position. For this reason, the user interface unit 110 provides an easy user interface for determining various processing targets and processing contents by a simple operation in which the user touches the liquid crystal display of the liquid crystal scanner touch panel unit 111 only once with a stamp. can do.

[Second Embodiment]
FIG. 9 is a schematic block diagram showing a functional configuration of the document management apparatus 200 according to the second embodiment of the present invention. In the figure, the same reference numerals (111, 114, 115, 120, 150) are assigned to portions corresponding to the respective portions in FIG. The document management apparatus 200 according to the present embodiment displays a list of stored documents, and a user touches a document in the list with a finger that designates approval, rejection, or deletion. A device that reads a fingerprint of a given finger and performs personal authentication, and registers either approval, denial, deletion, or display of a document touched by a finger, and a user interface Unit 210, document display processing unit 120, approval processing unit 230, rejection processing unit 240, deletion processing unit 150, and document storage unit 260. The user interface unit 210 includes a liquid crystal scanner touch panel unit 111, a fingerprint feature information extraction unit 212, an image generation unit 114, a processing determination unit 213, a coordinate storage unit 115, and a pattern storage unit 216, as will be described later.

  The user interface unit (user interface device) 210 displays a document list screen on the liquid crystal display of the liquid crystal scanner touch panel unit 111, and when the document list screen is touched with a finger, the position of the touched finger and the position of the touched finger are displayed. Based on the scanned image data obtained by reading the fingerprint, the document display processing unit 120, the approval processing unit 230, the rejection processing unit 240, and the deletion processing unit 150 determine which document to process and scan Personal authentication is performed based on image data, that is, a fingerprint. The approval processing unit 230 registers “approval” and the personal identification information of the approved user in the document storage unit 260 in association with the designated document data. The rejection processing unit 240 registers “rejection” and the personal identification information of the rejected user in the document storage unit 260 in association with the designated document data. The document storage unit 260 stores the document identification information for identifying the document data, the approval state of the document data, the personal identification information of the state setter, and the document data in association with each other.

As described above, the user interface unit (user interface device) 210 includes the liquid crystal scanner touch panel unit 111, the fingerprint feature information extraction unit 212, the image generation unit 114, the processing determination unit 213, the coordinate storage unit 115, and the pattern storage unit 216. It has. The fingerprint feature information extraction unit 212 extracts fingerprint feature information (for example, the branch / joint point of the line (ridge) constituting the fingerprint, the position of the start / end point, etc.) from the scanned image data of the fingerprint. The process determination unit 213 reads position information of the position detected by the liquid crystal scanner touch panel unit 111 and scan image data in the vicinity of the position from the liquid crystal scanner touch panel unit 111, and extracts a fingerprint feature information extraction unit from the read scan image data. Based on the feature information extracted by 212, personal authentication is performed with reference to the pattern storage unit 216, and approval processing, rejection processing, deletion processing, and processing to be executed are determined from the document display and read from the liquid crystal scanner touch panel unit 111. Based on the obtained position information, document data to be processed data to be executed determined with reference to the coordinate storage unit 115 is determined.
The pattern storage unit 216 corresponds to scanned image data, that is, pattern identification information including fingerprint characteristic information for identifying a fingerprint, personal identification information of a person having the fingerprint, and the scanned image data (finger represented by the fingerprint) The process identification information of the process to be performed is stored in association with each other.

  The document management apparatus 200 has the same hardware configuration as the document management apparatus 100 shown in FIG. 1, and includes the fingerprint feature information extraction unit 212, the process determination unit 213, the image generation unit 114, and the document display shown in FIG. The processing unit 120, the approval processing unit 230, the rejection processing unit 240, and the deletion processing unit 150 perform processing of each unit when the control unit 101 reads and executes a program stored in the memory 102. The coordinate storage unit 115, the pattern storage unit 216, and the document storage unit 260 are included in the memory 102, and information stored in these units is stored in the RAM of the memory 102 or a nonvolatile memory.

  FIG. 10 is a diagram illustrating an example of a document list screen and a document display screen displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 by the document management apparatus 200. Like the document list screen G2 and the document display screen D2 shown in FIG. 10, in the document list screen in this embodiment, icons representing unapproved document data are enumerated as icons IC3 and IC4. On the document display screen, the content of the document data of the selected icon is displayed. The user presses a pre-registered finger, for example, the right index finger, for the document data icon to be approved, and presses a pre-registered finger, for example, the left index finger, for the rejected document data icon, to the document data icon to be deleted. When the user presses a pre-registered finger, for example, the thumb of the left hand, the document management apparatus 200 reads the fingerprint of the finger, performs personal authentication based on the pre-registered fingerprint feature information, and the document data with the finger pressed Then, processing according to the pressed finger is performed. When an icon is pressed with another object such as a pen, the document management apparatus 200 displays the content of the document corresponding to the icon on the document screen. Here, in the pattern storage unit 216, the pattern information is fingerprint feature information of a finger of a person who has authority to instruct each process of approval, rejection, and deletion. This pattern information and personal identification information of the person of this pattern information And the process identification information of the process designated by the finger of the pattern information are stored in advance in association with each other.

  FIG. 11 is a diagram illustrating an example of stored contents of the pattern storage unit 216. The pattern storage unit 216 includes pattern identification information “fingerprint characteristic information (A. TAKATA's right hand index finger)”, personal identification information “A. TAKATA”, process identification information “approval”, pattern identification as illustrated in FIG. Information “fingerprint feature information (K. SUZUKI's right hand index finger)”, personal identification information “K. SUZUKI”, process identification information “approval”, pattern identification information “fingerprint feature information (A. TAKATA left hand index finger)” Pattern identification information, personal identification information, and process identification information are stored in advance in association with each other, such as personal identification information “A. TAKATA” and process identification information “denied”. Here, the “fingerprint feature information (A. TAKATA right hand index finger)”, “fingerprint feature information (K. SUZUKI right hand index finger)”, “fingerprint feature information (A. TAKATA "Left index finger)" represents information obtained by extracting feature points of each fingerprint.

  FIG. 12 is a diagram illustrating an example of the contents stored in the document storage unit 260. 12, the document identification information “070423RREQ”, the approval status “unapproved”, the status setter “−”, the document data “070423RREQ.TXT”, the document identification information “070420SREQ”, and the approval status illustrated in FIG. Document identification information, an approval state, a state setter, and document data are stored in association with each other such as “approved”, state setter “K.SUZUKI”, and document data “070420SREQ.TXT”. Here, there are three types of approval states: “unapproved” that has not yet been approved or rejected, “approved” that has been approved, and “denied” that has been rejected. The character string stored as the document data is the file name storing the document data, and the document storage unit 260 stores the file having the file name storing the actual document data.

  FIG. 13 is a flowchart for explaining the operation of the document management apparatus 100. First, the image generation unit 114 of the document management apparatus 100 selects document data whose approval status is “unapproved” from the document storage unit 260, and generates a document list screen in which icons representing the selected document data are arranged. Then, it is displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sb1). At this time, the image generation unit 114 stores the upper left and lower right coordinates of each icon in association with the document identification information of the document data represented by the icon in the coordinate storage unit 115. Here, it is assumed that the user of the personal identification information “A. TAKATA” presses the right index finger on one of the icons displayed on the document list screen. The process determining unit 213 includes position information (for example, coordinates on the screen such as “82, 93”) indicating coordinates where the right hand index finger is pressed, and a scan image of the fingerprint read when the right hand index finger is pressed. Data is read from the liquid crystal scanner touch panel unit 111 (Sb2). The fingerprint feature information extraction unit 212 performs feature information extraction processing on the scan image data of the fingerprint read by the processing determination unit 213 in step Sb2, and obtains feature information as a result of the extraction processing (Sb3). Next, the process determination unit 213 searches the pattern storage unit 216 to find pattern identification information that matches this feature information (Sb4).

  Next, the process determining unit 213 determines whether there is matching pattern identification information as a result of the search in step Sb4 (Sb5). If it is determined in step Sb5 that there is no matching pattern identification information, the process proceeds to step Sb6, and the coordinate storage unit 115 is searched for coordinate information representing an area including the coordinates represented by the position information read in step Sa2. To do. Next, the document display processing unit 120 reads out the document identification information stored in the coordinate storage unit 115 in association with the coordinate information searched in step Sb6, and further associates with the document identification information in the document storage unit 260. The document data stored in is read. The image generation unit 114 generates a document display screen for displaying the contents of the read document data, displays the document display screen on the liquid crystal display of the liquid crystal scanner touch panel unit 111, and ends the process.

  Here, as described above, since the user of the personal identification information “A. TAKATA” is pressing the right hand index finger, it is determined in step Sb5 that there is matching pattern identification information, the process proceeds to step Sb8, and the process proceeds to step Sb8. The determination unit 213 reads the personal identification information “A. TAKATA” stored in the pattern storage unit 216 in association with the pattern identification information that matches the feature information in the search in step Sb4. Next, the process determining unit 213 searches the coordinate storage unit 115 for coordinate information representing an area including the coordinates represented by the position information read in step Sb2.

  Next, the process determining unit 213 reads the process identification information stored in the pattern storage unit 216 in association with the pattern identification information searched in step Sb4, and whether or not the read process identification information is “approval”. Is determined (Sb10). When it is determined as “approved” in the determination in step Sab8, the process determining unit 213 reads out the document identification information stored in the coordinate storage unit 115 in association with the coordinate information searched in step Sb9. The document identification information and the personal identification information “A. TAKATA” read in step Sb8 are output to the approval processing unit 230 that performs the process represented by “approval”, thereby approving the processing of the document data of this document identification information. The processing unit 230 is instructed. The approval processing unit 230 searches the document storage unit 260 using the received document identification information as a key, and sets “approved” as the approval state of the corresponding document data, and the personal identification received from the processing determination unit 213 by the state setter. Information "A. TAKATA" is registered (Sb11). An approval screen for notifying the user that the image generation unit 114 has approved is generated, displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sb12), and the process ends.

  On the other hand, if it is determined in step Sb10 that the process identification information is not “approved”, the process transitions to step Sb13, and the process determination unit 213 determines whether the process identification information is “denied” or not. Is determined (Sb13). If it is determined in step Sb13 that the result is “No”, the process determining unit 213 stores the document identification information stored in the coordinate storage unit 115 in association with the coordinate information obtained in step Sb9. And the document identification information and the personal identification information “A. TAKATA” read in step Sb8 are output to the rejection processing unit 240 that performs the process represented by “rejection”. The processing is instructed to the rejection processing unit 240. The rejection processing unit 240 searches the document storage unit 260 by using the received document identification information as a key, and identifies “rejected” as the approval status of the corresponding document data, and the personal identification received from the processing determination unit 213 by the status setter. Information is registered (Sb14). A rejection screen for notifying the user that the image generation unit 114 has rejected is generated and displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sb15), and the process ends.

  If it is determined in step Sb13 that the above-described process identification information is not “decision”, the process proceeds to step Sb16, and the process determination unit 213 stores the coordinate information in association with the coordinate information searched in step Sb9. The document identification information stored in the unit 115 is read out, and the document identification information is output to the deletion processing unit 150 that performs the process represented by “deletion”, whereby the processing of the document data of the document identification information is deleted. To instruct. The deletion processing unit 150 searches the document storage unit 160 using the received document identification information as a key, and deletes the corresponding document data and items associated with the document data from the document storage unit 160 (Sb16). A deletion screen for notifying the user that the image generation unit 114 has deleted is generated, displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111 (Sb17), and the process ends.

Before step Sb16, a step for determining whether or not it is “deleted” is inserted. When it is determined that it is “deleted”, the process proceeds to step Sb16. Otherwise, the process proceeds to step Sb6. You may make it do.
Also, in the match determination by the process determination unit 213 in step Sb5, even if not all feature information included in the pattern identification information matches, for example, if feature information of a certain ratio or more matches, they match. You may make it determine with it.
Further, in this embodiment, there are only four types of processing contents of approval, rejection, deletion, and document display, but the pattern information is associated with other processing identification information using the fingerprint fingerprint characteristic information as pattern identification information. It may be stored in the storage unit 216 so that more types of processing contents can be instructed.

  As described above, the liquid crystal scanner touch panel unit 111 outputs the position information indicating the touch position of the finger and the scan image data of the fingerprint of the touched finger, and the process determination unit 213 executes the process executed based on the scan image data of the fingerprint. Data to be processed is determined based on the pressed position. For this reason, the user interface unit 210 determines various processing targets and processing contents by a simple operation in which the user touches the liquid crystal display of the liquid crystal scanner touch panel unit 111 only once with a finger, and further scans a fingerprint. It is possible to provide an easy user interface capable of authenticating an individual on the basis of image data and making the above-described processing content according to the authentication result.

[Third Embodiment]
FIG. 14 is a schematic system configuration diagram showing the configuration of the Internet sales system according to the third embodiment of the present invention. The Internet sales system in this embodiment includes a network sales server 300 installed by a sales company, a plurality of network sales terminal devices 400 installed in stores, and a network 500 that connects these. When the online sales terminal device 400 that has received a user operation applies to the online sales server 300 for purchase of a product, the online sales server 300 performs a sales process such as a product delivery instruction or a settlement process.
Note that the net sales server 300 is connected to an input device, a display device, and the like (neither shown) as peripheral devices. Here, the input device refers to an input device such as a keyboard and a mouse. The display device refers to a CRT (Cathode Ray Tube), a liquid crystal display device, or the like.

  FIG. 15 is a schematic block diagram showing the configuration of the net sales server 300 and the net sales terminal device 400 in the present embodiment. The net sales terminal device 400 includes a liquid crystal scanner touch panel unit (display scanner touch panel) 410 and a communication unit 420. The liquid crystal scanner touch panel 410 receives and displays the image data generated by the image generator 320 on the liquid crystal display via the communication unit 310 and the communication unit 420 in the same manner as the liquid crystal scanner touch panel 111 shown in FIG. By detecting light incident on the liquid crystal display from the outside, the image display area of the liquid crystal display is scanned to generate scan image data. Furthermore, the liquid crystal scanner touch panel unit 410 detects a position designated from the outside by the liquid crystal display. The communication unit 420 communicates with the online sales server 300 via the network 500.

  The online sales server 300 includes a communication unit 310, an image generation unit 320, a processing determination unit 330, a coordinate storage unit 340, a pattern storage unit 350, a sales processing unit 360, and a fingerprint feature information extraction unit 370. The communication unit 310 communicates with the network sales terminal device 400 via the network 500. The image generation unit 320 generates image data of a product list screen in which icons or photographs each representing a product are read from the coordinate storage unit 340 and arranged, and transmits the data to the net sales terminal device 400 via the communication unit 310. The image is displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 111. At this time, the image generation unit 320 associates the coordinates of the upper left and lower right of each icon or photo when the upper left corner of the screen is the origin with the product identification information of the product represented by the icon or photo, and the coordinate storage unit Store in 340. Further, after performing the sales process, the image generation unit 320 generates screen image data for notifying the user of the processing result, and transmits the screen image data to the net sales terminal device 400 via the communication unit 310, and the liquid crystal scanner touch panel Display on the liquid crystal display of the unit 111.

The processing determining unit 330 is configured to detect the position information of the position detected by the liquid crystal scanner touch panel 410 of the net sales terminal device 400 and scan image data in the vicinity of the position, for example, a square area of 50 pixels vertically and horizontally centered on the position. The scanned image data is received from the liquid crystal scanner touch panel unit 410 via the communication unit 420 and the communication unit 310, and the pattern storage is performed based on the feature information extracted by the fingerprint feature information extraction unit 370 from the fingerprint in the received scan image data. The processing target of the execution process determined with reference to the coordinate storage unit 340 based on the position information received from the liquid crystal scanner touch panel unit 410 is determined based on the position information received from the liquid crystal scanner touch panel unit 410 Product identification information to be data is determined.
The coordinate storage unit 340 stores product identification information, icon or photo data representing the product, and coordinate information representing an area where the product icon is displayed on the product list screen in association with each other.
The pattern storage unit 350 stores scanned image data, that is, pattern identification information including fingerprint characteristic information for identifying a fingerprint and personal identification information of a person having the fingerprint in association with each other.
The fingerprint feature information extraction unit 370 extracts fingerprint feature information (for example, the branch / joint point of the line (ridge) constituting the fingerprint, the position of the start / end point, etc.) from the scanned image data of the fingerprint.
In this embodiment, the image generation unit 320, the processing determination unit 330, the coordinate storage unit 340, the pattern storage unit 350, and the fingerprint feature information extraction unit 370 of the net sales server 300 are combined with a user interface unit (user interface device) 600. Configure.

  FIG. 16 is a diagram illustrating an example of a product list screen displayed on the liquid crystal display of the liquid crystal scanner touch panel unit 410 by the net sales terminal device 400. Like the product list screen G3 shown in FIG. 16, on the product list screen in this embodiment, icons or photographs each representing a product are listed as icons IC5 and IC6. When the user presses an icon or photo of a product to be purchased with a pre-registered finger, for example, an index finger of the left hand, the liquid crystal scanner touch panel unit 410 reads the fingerprint of the pressed finger to generate scan image data, and the communication unit 420 To the online sales server 300. In the online sales server 300, the processing determination unit 330 that has received the scanned image data via the communication unit 310 performs personal authentication based on pre-registered fingerprint feature information and also displays the product of the icon whose finger is pressed. A purchase process is instructed to the sales processing unit 360. Here, the pattern storage unit 350 uses the fingerprint fingerprint feature information of the user who subscribes to the Internet sales service as pattern information, and associates the pattern information with the personal identification information of the person of the pattern information. Store in advance.

  FIG. 17 is a diagram illustrating an example of stored contents of the pattern storage unit 350. As illustrated in FIG. 17, the pattern storage unit 350 includes pattern information “fingerprint feature information (K. TANAKA's right hand index finger)”, personal identification information “K. TANAKA”, and pattern information “fingerprint feature information (T Pattern information and personal identification information are stored in association with each other, such as “.HONDA's right hand index finger”) and personal identification information “T.HONDA”. Here, the pattern information “fingerprint feature information (K. TANAKA's right hand index finger)” is the fingerprint feature information of the right hand index finger of the user “K. TANAKA”. The personal identification information “K. TANAKA” is information for identifying the user “K. TANAKA”.

  FIG. 18 is a diagram illustrating an example of stored contents of the coordinate storage unit 340. In the coordinate storage unit 340, as illustrated in FIG. 18, coordinate information “20, 30, 120, 130” representing the upper left and lower right coordinates of the rectangular area on the screen, and image data that is the file name of the image data Coordinate information and image such as “A1.jpg”, product identification information “A1”, coordinate information “10, 180, 120, 280”, image data “A2.jpg”, and product identification information “A2”. Data and product identification information are stored in association with each other. Here, the coordinate information is a number representing the upper left coordinates and the lower right coordinates of the rectangular area in which the associated image data is displayed, as in FIG. The image data is a file name of a file storing product image data. The coordinate storage unit 340 stores a file having a file name stored in the image data. The product identification information is information for identifying a product.

  FIG. 19 is a flowchart for explaining operations of the net sales server 300 and the net sales terminal device 400 in the present embodiment. First, the image generation unit 320 of the net sales server 300 reads a file having a file name of image data from the coordinate storage unit 340, generates a product list screen in which images according to the contents of the read file are arranged, and generates a communication unit 310, The information is displayed on the liquid crystal scanner touch panel 410 of the net sales terminal device 400 via 420 (Sc1). At this time, the image generation unit 320 displays each image in a rectangular area represented by the coordinate information stored in association with the coordinate storage unit 340. Here, it is assumed that the user of the personal identification information “T.HONDA” presses the right index finger on one of the images displayed on the product list screen. The liquid crystal scanner touch panel unit 410 transmits the position information indicating the coordinates where the finger is pressed and the scan image data of the fingerprint read when the finger is pressed via the communication unit 420. The communication unit 310 of the net sales server 300 receives the transmitted position information and scan image data, and the process determination unit 330 reads the received position information and scan image data (Sc2). The fingerprint feature information extraction unit 370 performs feature information extraction processing on the scan image data of the fingerprint read in step Sc2, and obtains feature information as a result of the extraction processing. Next, the process determining unit 330 searches the pattern storage unit 350 to search for pattern identification information that matches the feature information (Sc4).

  Next, as a result of the search in step Sc4, the process determining unit 330 determines whether there is pattern identification information that matches this feature information (Sc5). When it is determined in step Sc5 that there is no matching pattern identification information, the process proceeds to step Sc6 to generate a personal authentication failure screen that notifies the user that the image generation unit 320 has failed personal authentication. The display data of the screen is transmitted via the communication unit 310. The liquid crystal scanner touch panel unit 410 of the net sales terminal device 400 receives the transmitted display data via the communication unit 420, displays the received display data on the liquid crystal display (Sc6), and ends the process.

  Here, as described above, since the user of the personal identification information “T.HONDA” is pressing the right hand index finger, it is determined in step Sc5 that there is matching pattern identification information, and the process proceeds to step Sc7. The determination unit 330 reads the personal identification information “T.HONDA” stored in the pattern storage unit 350 in association with the pattern identification information. Next, the process determining unit 330 searches the coordinate storage unit 340 for coordinate information representing an area including the coordinates represented by the position information read in step Sc2 (Sc8). The process determining unit 330 reads the product identification information stored in the coordinate storage unit 340 in association with the coordinate information obtained as a result of the search in step Sc8, and the personal identification information “T.HONDA” read in step Sc8. The product represented by the product identification information is output to the sales processing unit 360 as an instruction to sell to the user represented by the personal identification information “T.HONDA”.

  Upon receiving the product identification information and the personal identification information, the sales processing unit 360, based on these information, a settlement process or a delivery instruction process for selling the product of the product identification information to the user of the personal identification information (Sc9). When the sales processing unit 360 ends the sales process of step Sc9, the image generation unit 320 generates display data of a sold screen that notifies the user that the sales process has ended, and the generated display data is transmitted to the communication unit 310. To send through. The liquid crystal scanner touch panel unit 410 of the net sales terminal device 400 receives the transmitted display data via the communication unit 420, displays the received display data on the liquid crystal display (Sc10), and ends the process.

In the match determination by the processing determination unit 330 in step Sc5, even if not all feature information included in the pattern identification information matches, for example, if feature information of a certain ratio or more matches, they match. You may make it determine with it.
Further, in the present embodiment, the processing content is only the sales processing to the user who has been personally authenticated, but the pattern storage unit 216 associates the fingerprint characteristic information including other fingers with the processing identification information as pattern identification information. The processing determination unit 330 may be able to instruct the processing content according to the processing identification information.

  As described above, the liquid crystal scanner touch panel unit 410 outputs the position information indicating the touch position of the finger and the scan image data of the fingerprint of the touched finger, and the processing determination unit 330 determines the product according to the output position information. Then, the sales processing destination user is determined according to the scanned image data of the fingerprint. For this reason, the user interface unit 600 determines various processing targets and processing contents by a simple operation in which the user touches the liquid crystal display of the liquid crystal scanner touch panel unit 410 only once with a finger, and further scans a fingerprint. It is possible to provide an easy user interface capable of authenticating an individual on the basis of image data and making the above-described processing content according to the authentication result.

  In the first to third embodiments, an icon or an image representing the processing target data is displayed, and the processing determining units 113, 213, and 330 are processing targets based on the positions detected by the liquid crystal scanner touch panel units 111 and 410. Although it has been described that data is determined and the process is determined based on the scan image data generated by the liquid crystal scanner touch panel units 111 and 410, an icon representing the process is displayed and based on the position detected by the liquid crystal scanner touch panel units 111 and 410. The processing target data may be determined based on the scan image data generated by the liquid crystal scanner touch panel units 111 and 410.

  In addition, the liquid crystal scanner touch panel units 111 and 410 arrange an image display liquid crystal element and a scanning optical sensor element on the same glass substrate, and display an image on the liquid crystal element. In the above description, the scan image data is generated by detecting the light incident on the image display area. However, an image may be displayed by an organic EL (ElectroLuminescence) element other than liquid crystal, or the optical sensor element may be a glass substrate. The optical path may be set so that the incident light is guided to the arrangement place.

  In addition, the two-dimensional barcode decoding unit 112, the image generation unit 114, the processing determination unit 113, the document display processing unit 120, the approval processing unit 130, the rejection processing unit 140, the deletion processing unit 150, or the fingerprint shown in FIG. Feature information extraction unit 212, image generation unit 114, processing determination unit 213, document display processing unit 120, approval processing unit 230, rejection processing unit 240, deletion processing unit 150, or communication unit 420, communication unit 310, image in FIG. A program for realizing the functions of the generation unit 320, the processing determination unit 330, the sales processing unit 360, and the fingerprint feature information extraction unit 370 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is recorded on the computer. These processes may be performed by reading the system and executing it. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like within a scope not departing from the gist of the present invention.

  The present invention is optimally used for a document management apparatus and an Internet sales system as shown in the first to third embodiments, but is not limited to this.

It is a schematic block diagram which shows the hardware constitutions of the document management apparatus 100 by 1st Embodiment of this invention. It is a schematic block diagram which shows the function structure of the document management apparatus 100 by the embodiment. It is a figure which shows typically the structural example of the liquid crystal display which the liquid crystal scanner touch panel part 111 by the embodiment has. 6 is a diagram illustrating an example of a document list screen and a document display screen displayed on the liquid crystal scanner touch panel unit 111 by the document management apparatus 100 in the embodiment. FIG. It is a figure which shows the example of the memory content of the pattern memory | storage part 116 in the embodiment. It is a figure which shows the example of the memory content of the coordinate memory | storage part 115 in the embodiment. It is a figure which shows the example of the memory content of the document memory | storage part 160 in the same embodiment. 6 is a flowchart for explaining the operation of the document management apparatus 100 in the embodiment. It is a schematic block diagram which shows the function structure of the document management apparatus 200 by 2nd Embodiment of this invention. 5 is a diagram showing an example of a document list screen and a document display screen displayed on the liquid crystal scanner touch panel unit 111 by the document management apparatus 200 in the embodiment. FIG. It is a figure which shows the example of the memory content of the pattern memory | storage part 216 in the embodiment. It is a figure which shows the example of the memory content of the document memory | storage part 260 in the embodiment. 6 is a flowchart for explaining the operation of the document management apparatus 100 in the embodiment. It is a schematic system block diagram which shows the structure of the internet sales system by 3rd Embodiment of this invention. It is a schematic block diagram which shows the structure of the net sales server 300 and the net sales terminal device 400 in the embodiment. 5 is a diagram showing an example of a product list screen displayed on the liquid crystal scanner touch panel unit 410 by the net sales terminal device 400 in the same embodiment. FIG. It is a figure which shows the example of the memory content of the pattern memory | storage part 350 in the embodiment. It is a figure which shows the example of the memory content of the coordinate memory | storage part 340 in the same embodiment. It is a flowchart explaining operation | movement of the net sales server 300 and the net sales terminal device 400 in the embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100, 200 ... Document management apparatus 101 ... Control part 102 ... Memory 103 ... Input / output part 110, 210, 600 ... User interface part 111, 410 ... Liquid crystal scanner touch panel part 112 ... Two-dimensional barcode decoding part 113, 213, 330 ... Processing determination unit 114, 320 ... Image generation unit 115, 340 ... Coordinate storage unit 116, 216, 350 ... Pattern storage unit 120 ... Document display processing unit 130, 230 ... Approval processing unit 140, 240 ... Denial processing unit 150 ... Deletion processing Unit 160, 260 ... Document storage unit 212 ... Fingerprint feature information extraction unit 300 ... Net sales server 310 ... Communication unit 360 ... Sales processing unit 370 ... Fingerprint feature information extraction unit 400 ... Net sales terminal device 420 ... Communication unit 500 ... Network

Claims (10)

A display scanner touch panel for displaying an image on the image display surface, detecting scan light data by detecting light incident from the outside on the image display surface, and detecting a position instructed from the outside on the image display surface; ,
Of the scanned image data generated by the display scanner touch panel, based on the scanned image data in the vicinity of the detected position and the detected position, the process to be executed and the data to be processed are determined. A user interface device comprising: a process determining unit that instructs the process to process the determined processing target data.   The process determining unit determines a process to be executed based on scan image data in the vicinity of the detected position, and determines processing target data for the process to be executed based on the detected position. Item 4. The user interface device according to Item 1. A coordinate storage unit for storing data identification information or processing target data for identifying processing target data and information representing an area on the image display surface in association with each other;
A pattern storage unit that stores pattern identification information for identifying scan image data and process identification information for identifying a process in association with each other;
An image representing the processing target data is displayed on an image display surface of the display scanner touch panel, information representing a region where the image is displayed, processing target data represented by the image, or data identification information for identifying the processing target data, And an image generation unit that stores the information in the coordinate storage unit in association with each other,
The process determination unit is a process for executing the process represented by the process identification information stored in the pattern storage unit in association with the pattern identification information for identifying the scan image data in the vicinity of the detected position. The processing target data stored in the coordinate storage unit in association with information indicating a region including a position or processing target data represented by data identification information is set as processing target data of the process to be executed. Item 3. The user interface device according to Item 2.   The process determining unit detects a process to be executed and processing target data of the process based on scan image data in the vicinity of the detected position and the detected position, and scan images in the vicinity of the detected position. The user interface device according to claim 1, wherein personal authentication processing is performed based on the data. A coordinate storage unit for storing data identification information or processing target data for identifying processing target data and information representing an area on the image display surface in association with each other;
A pattern storage unit for storing pattern identification information for identifying scanned image data and personal identification information for identifying an individual in association with each other;
An image representing the processing target data is displayed on an image display surface of the display scanner touch panel, information representing a region where the image is displayed, processing target data represented by the image, or data identification information for identifying the processing target data, And an image generation unit that stores the information in the coordinate storage unit in association with each other,
The process determining unit reads out personal identification information stored in the pattern storage unit in association with pattern identification information for identifying scan image data in the vicinity of the detected position, and performs personal authentication. The processing to be executed is determined based on the result of the above, and the processing target data stored in the coordinate storage unit or the processing target data represented by the data identification information is executed in association with the information indicating the area including the detected position. The user interface device according to claim 4, wherein the data is processing target data. A coordinate storage unit for storing data identification information or processing target data for identifying processing target data and information representing an area on the image display surface in association with each other;
A pattern storage unit that stores pattern identification information for identifying scanned image data, personal identification information for identifying an individual, and processing identification information for identifying a process in association with each other;
An image representing the processing target data is displayed on an image display surface of the display scanner touch panel, information representing a region where the image is displayed, processing target data represented by the image, or data identification information for identifying the processing target data, And an image generation unit that stores the information in the coordinate storage unit in association with each other,
The process determination unit reads out personal identification information stored in the pattern storage unit in association with pattern identification information for identifying scan image data in the vicinity of the detected position, performs personal authentication, and performs the pattern identification. The process identification information stored in the pattern storage unit in association with the information and the personal identification information is read out, and a process for executing the process identified by the read process identification information is performed. The processing target data stored in the coordinate storage unit in association with the information to be expressed or the processing target data represented by the data identification information is set as processing target data for the process to be executed. A user interface device according to claim 1. A fingerprint feature information extraction unit for extracting fingerprint feature information from the scanned image data;
6. The user interface according to claim 1, wherein the process determining unit determines based on the feature information extracted by the fingerprint feature information extracting unit from the scanned image data. 7. apparatus. A display scanner touch panel that displays an image on an image display surface, generates scan image data by detecting light incident on the image display surface from the outside, and further detects a position instructed from the outside on the image display surface Of the generated scan image data, the process to be executed and the data to be processed are determined based on the scan image data in the vicinity of the detected position and the detected position. A user interface device comprising: a process determining unit that instructs to process the processed data. A display scanner touch panel that displays an image on an image display surface, detects light incident on the image display surface from outside to generate scan image data, and further detects a position instructed from the outside on the image display surface A user interface method in a user interface device comprising:
A first process in which the display scanner touch panel detects light incident on the image display surface from outside to generate scan image data, and detects a position instructed from the outside on the image display surface;
Processing performed by the user interface device based on scan image data in the vicinity of the position detected in the first process and the detected position among the scan image data generated in the first process; A second step of determining processing target data of the processing;
A user interface method, wherein the user interface device includes a third process instructing the processing of data to be processed determined in the second process to the process determined in the second process. . A display scanner touch panel that displays an image on an image display surface, detects light incident on the image display surface from outside to generate scan image data, and further detects a position instructed from the outside on the image display surface A user interface device computer comprising:
Of the scanned image data generated by the display scanner touch panel, based on the scanned image data in the vicinity of the detected position and the detected position, the process to be executed and the data to be processed are determined. A program that causes a process to function as a process determination unit that instructs the process of the determined processing target data.

Images