JP2023138307A - Display device, electronic signature method, program, and electronic signature system - Google Patents

Abstract

To improve convenience when selectively drawing a text or a graphic through a handwriting operation or creating an electronic signature through a handwriting operation.SOLUTION: A display device for displaying handwritten information, as objects includes: an input receiving unit which receives a handwritten input; a conversion unit which converts the handwritten input into a text or a graphic; a determination unit which determines whether the converted text or graphic is a preset recognition character string or recognition graphic; a display control unit which displays display components for accepting creation of an electronic signature based on the preset recognition character string or recognition graphic, when the determination unit determines that the converted text or graphic is the preset recognition character string or recognition graphic; and an electronic signature unit which creates the electronic signature when accepting a selection of the display components.SELECTED DRAWING: Figure 2

Description

The present invention relates to a display device, an electronic signature method, a program, and an electronic signature system.

2. Description of the Related Art Display devices are known that use handwritten character recognition technology to convert handwritten data into text such as characters and display the converted text on a display. Display devices equipped with relatively large touch panels are placed in conference rooms, public facilities, etc., and used by multiple users as electronic whiteboards.

A technique for creating authentication data using handwritten data has been devised (for example, see Patent Document 1). Patent Document 1 discloses a technique for accepting input of handwritten signature data in a signature input field and storing authentication data so as to enable user authentication.

However, the conventional technology does not take into account the convenience of using the different methods of drawing text or figures by handwriting and creating electronic signatures by handwriting.

In view of the above-mentioned problems, it is an object of the present invention to improve the convenience when drawing text or figures by handwriting and creating an electronic signature by handwriting.

In view of the above problems, the present invention provides a display device that displays handwritten text as an object,
an input reception unit that receives the handwritten input; a conversion unit that converts the handwritten text into text or a figure; and a judgment unit that determines whether the converted text or figure is a preset recognition character string or recognition figure. and a determining unit that determines that the converted text or figure is the preset recognized character string or the recognized figure based on the preset recognized character string or recognized figure. It has a display control unit that displays a display component that accepts the creation of an electronic signature, and an electronic signature unit that creates the electronic signature when the selection of the display component is accepted.

It is possible to improve the convenience when drawing text or figures by handwriting and creating an electronic signature by handwriting.

FIG. 3 is a diagram illustrating an electronic signature given to saved data saved by a display device. FIG. 2 is a diagram illustrating a flow of processing in which a display device creates an electronic signature. 1 is an example of a schematic configuration diagram of a display system. 1 is an example of a hardware configuration diagram of a display device. 1 is an example of a hardware configuration diagram of a computer. FIG. 2 is an example of a functional block diagram illustrating functions of a display device and a terminal device divided into blocks. FIG. 3 is a diagram schematically showing objects held by an object storage unit. FIG. 3 is a diagram schematically showing command definition data stored in a command definition data storage unit. FIG. 3 is a diagram schematically showing electronic signature information stored in an electronic signature information storage unit. FIG. 3 is a diagram illustrating an example of an electronic signature information registration screen displayed by a terminal device. FIG. 3 is an example of a flowchart illustrating a procedure in which the display device receives registration of electronic signature information. FIG. It is an example of a diagram showing an electronic signature information list screen and a confirmation message. FIG. 3 is an example of a flowchart illustrating a procedure in which the display device accepts deletion of electronic signature information. FIG. FIG. 3 is a diagram illustrating the transition of information displayed regarding a signature field. FIG. 2 is an example of a flowchart illustrating a process in which a display device creates an electronic signature in response to handwriting on a signature field. FIG. FIG. 7 is an example of a flowchart illustrating a process in which the electronic signature unit determines whether or not the signer's text has been input in the signature field. FIG. It is an example of a diagram showing a signature field and an operation guide including an operation command for displaying a signature field. FIG. 7 is an example of a flowchart diagram illustrating a process in which the display device newly displays a signature field. FIG. FIG. 7 is an example of a diagram showing operation commands for creating an electronic signature displayed by the display device when the user does not use the signature field. FIG. 3 is an example of a flowchart illustrating a process in which a display device creates an electronic signature without using a signature field. FIG. FIG. 2 is a diagram illustrating an example of a system configuration diagram when a display device uses a timestamp server. FIG. 2 is an example of a diagram showing a URL setting screen displayed by a terminal device when a user sets a URL of a time stamp server on a display device. FIG. FIG. 7 is an example of a flowchart diagram illustrating a process in which the display device receives the setting of a URL of a time stamp server. FIG. FIG. 3 is an example of a flowchart illustrating a process in which a time stamp is added to a process in which a display device creates an electronic signature; FIG. 1 is a schematic system configuration diagram of an electronic signature system. FIG. 2 is an example of a functional block diagram illustrating functions of a display device, an electronic signature server, and a terminal device divided into blocks. 3 is an example of a diagram showing electronic signature identification information stored in an electronic signature identification information storage unit; FIG. 3 is an example of a sequence diagram illustrating a process in which the electronic signature system creates an electronic signature in response to a request from a display device. FIG. 1 is an example of a functional block diagram illustrating functions of a display device and a terminal device divided into blocks; FIG. FIG. 3 is a diagram showing an example of an electronic signature information registration screen. FIG. 3 is an example of a diagram showing operation commands and the like displayed by the display device at the time of login. FIG. 7 is an example of a diagram showing another example of operation commands etc. displayed by the display device at the time of login. FIG. 3 is a diagram showing an example of an input screen displayed by a display device. It is an example of a diagram showing a signature execution dialog and a message. 2 is an example of a flowchart diagram illustrating a process in which a display device creates an electronic signature. 1 is an example of a functional block diagram illustrating functions of a display device and a terminal device divided into blocks; FIG. FIG. 2 is an example of a flowchart illustrating a process in which a display device automatically creates a digital signature. FIG. 1 is an example of a system configuration diagram of a remote communication system. FIG. 2 is an example of a functional block diagram of a mediation server. FIG. FIG. 3 is an example of a sequence diagram illustrating a process in which a plurality of display devices share an object and a digital signature. FIG. 3 is a diagram schematically showing command definition data stored in a command definition data storage unit. FIG. 3 is a diagram illustrating an example of a signature execution command. 2 is an example of a flowchart diagram illustrating a process in which a display device creates an electronic signature and stores it in a USB memory.

DESCRIPTION OF THE PREFERRED EMBODIMENTS A display device and an electronic signature method performed by the display device will be described below as an example of a mode for carrying out the present invention with reference to the drawings.

<Outline of electronic signature>
First, electronic signatures will be explained with reference to FIG. FIG. 1 is a diagram illustrating an electronic signature given to saved data saved by the display device 2. As shown in FIG. 1(a), user A handwritten "ABC". The data "ABC" may be saved as a coordinate point sequence or may be saved in a file such as PDF.

FIG. 1(b) shows the flow of creating an electronic signature. As described later, when user A inputs an operation for adding an electronic signature to stored data, the display device 2 creates an electronic signature in the following procedure. Note that user A has already obtained an electronic certificate for his private key and a public key for this private key from a certification authority or the like.

(1) The display device 2 converts the stored data 101 using a hash function to generate a hash value 102. Note that the saved data 101 is electronic data.

(2) The display device 2 encrypts this hash value 102 with the private key 105 corresponding to the public key certified by the electronic certificate. This act or the data created by the act is called an electronic signature 103. There are various encryption algorithms, such as "DES", "RC4", "AES", etc., and the algorithm does not matter.

(3) The display device 2 combines the stored data 101 (plaintext) and the electronic signature 103 and stores it together with the electronic certificate 104.

In order for user A to confirm that the stored data 101 has not been tampered with, the display device 2 generates a hash value from the stored data 101 using the same hash function. The display device 2 decrypts the electronic signature 103 with the public key and obtains the hash value 102. If the two hash values match, the display device 2 indicates that the stored data has not been tampered with and that the data is the data stored by the display device 2. I can confirm that there is.

<Outline of electronic signature on display device>
Referring to FIG. 2, an outline of the electronic signature on the display device 2 will be explained. FIG. 2 is a diagram illustrating the flow of processing in which the display device 2 creates an electronic signature. Note that the process flow in FIG. 2 is an example, and the process flow may change depending on the presence or absence of the signature field 110 (an example of an input field), the presence or absence of private key and public key registration, and the like.

As shown in FIG. 2A, a user who wishes to give an electronic signature inputs handwritten data 118 to display a signature field creation command 112 in order to display a signature field 110. In FIG. 2A, the handwritten word "shome" partially matches a recognized character string (for example, "shome", signature, etc.) in command definition data, which will be described later. For this reason, a signature field creation command 112 "Create a signature field" and a signature execution command 113 "Sign information Sec-G" are displayed on the operation guide 500.

A supplementary note regarding the operation guide 500. The operation guide 500 displays recognition results (text) of handwritten data and predictively converted text (character string candidates 114 displayed on the operation guide). The text selected with the operation guide 500 is displayed in place of the handwritten data. The operation guide 500 may display various operation commands based on command definition data. In this embodiment, an electronic signature may be created by selecting an operation command. Note that the "■" at the beginning of the signature field creation command 112 and signature execution command 113 indicates that these are not character string candidates 114 but commands.

As shown in FIG. 2B, when the user selects the signature field creation command 112 with the pen 2500, the display device 2 displays the signature field 110. The signature field 110 displays placeholder text "Please sign here." Placeholder text is explanatory text that is displayed inside until it is touched.

Note that when the user selects the signature execution command 113 with the pen 2500 in FIG. 2A, the display device 2 can create an electronic signature using the electronic signature information associated with "information Sec-G". In this case, subsequent processing is unnecessary.

As shown in FIG. 2(c), the user writes by hand in the signature field 110 in order to retrieve his/her electronic signature information. Here, assuming that the user is a member of the information security group, electronic signature information of the information security group is used. For this reason, the user handwritten, for example, ``jo''. The display device 2 displays several character string candidates 114 by character recognition of "jo". The character string candidates 114 include a text into which "jo" is converted, a kanji character which is predictively converted from this text, and the like.

As shown in FIG. 2(d), when the user uses the electronic signature information of the information security group, the user selects "information security group" from the character string candidates 114 in FIG. 2(c) with the pen 2500. The display device 2 displays "Information Security Group" in the signature field 110.

As shown in FIG. 2(e), since the text "Information Security Group" has been input in the signature field 110, the display device 2 determines whether electronic signature information is associated with this text (Information Security Group). to decide. If the text entered in the signature field 110 is associated with electronic signature information, the display device 2 displays a check mark 111 in the signature field 110. In this way, the check mark 111 indicates that electronic signatures are possible.

As shown in FIG. 2F, when the user touches the check mark 111 with the pen 2500, the display device 2 inverts the check mark 111 and creates an electronic signature.

In this way, the display device 2 of this embodiment can create the signature field 110 and create a signature using pen input. The user can simply use text converted from handwritten data for input, or select the Execute Signature command 113 to create an electronic signature, allowing the user to enter text and create an electronic signature. There is no need to switch. Users can easily create electronic signatures by executing commands, so they can create electronic signatures without reducing work efficiency. With this configuration, it is possible to selectively use handwriting as an operation for drawing text or figures, or as an operation for creating an electronic signature. Note that the content handwritten by the user is not limited to text. In addition to converting handwritten data into text, handwritten data may be converted into figures. If the converted figure matches a preset recognition figure for creating an electronic signature, a signature execution command 113 may be displayed to accept a selection from the user.

<About terms>
The input means may be any means that allows handwriting by specifying coordinates on a touch panel. Examples include a pen, a human finger or hand, and a rod-shaped member.

A series of operations in which the user presses the input device against the display, continuously moves it, and then releases it from the display is called a stroke. Stroking involves tracking the user's movements without touching the display. In this case, the display device may initiate the stroke by a user's gesture, by pressing a button with the user's hand or foot, or in some other way, for example using a mouse or pointing device. Additionally, the user may terminate the stroke using the same or a different gesture, releasing a button, or using a mouse or pointing device.

Stroke data is information displayed on a display based on a trajectory of coordinates input by an input means. Stroke data may be interpolated as appropriate. Handwritten data is data that includes one or more stroke data. Handwritten input indicates that handwritten data is input by the user. Handwriting input may be performed using a touch interface, a tactile object such as a pen or stylus, or the user's body. Handwriting input may also be performed via other types of input, such as gesture-based input, hand movement tracking input, or other touch-free input by the user. Although embodiments of the invention refer to handwritten input and handwritten input data, other forms of handwritten input may be utilized.

An object displayed on a display based on stroke data is called an object. The term "object" means a target, and in this embodiment, it means a display target. Objects converted by handwriting recognition of stroke data may include, in addition to text, fixed characters such as "done", stamps displayed as marks, figures such as circles and stars, straight lines, and the like. The text is the result of character recognition of handwritten data. Data used to display objects is called object data.

An electronic signature is data that proves that an electronic document (saved data) belongs to the signer himself and that the contents have not been tampered with. An object saved in a file or the like is called saved data.

Display parts are characters, figures, etc. that are related to instructions so that operations can be instructed by pointing and selecting them on the computer screen. In this embodiment, display components are explained using the term operation command.

Signer information is information that can specify, specify, or identify a signer. In this embodiment, the name of the signer is used as the signer information, but the signer information may be any information associated with the signer, such as the signer ID.
Figures refer to various shapes determined by certain rules. There are many types of shapes, such as triangles, squares, circles, and rhombuses, but the shapes for creating electronic signatures are preset. The user can display the shape as a shape, or use the shape to select to create an electronic signature (the shape used to select to create an electronic signature will be deleted). Therefore, in this embodiment, it is determined whether strokes handwritten by the user are recognized as text or graphics.

<System configuration example>
The configuration of the display system 100 will be described with reference to FIG. 3. FIG. 3 is an example of a schematic configuration diagram of the display system 100. The display system 100 includes a display device 2, and the display device 2 and a terminal device 30 communicate with each other by short-range wireless communication. The wireless communication method may be, for example, Wi-Fi (wireless LAN), Bluetooth (registered trademark), infrared communication, visible light communication, or IC card communication. Further, in the case of Wi-Fi, the communication method may be an ad hoc mode or an infrastructure mode.

The display device 2 displays data handwritten on a touch panel using an input means such as a pen or a finger. The display device 2 of this embodiment includes a large display that is used by multiple people in an office or on-site, and is assumed to be used as an electronic whiteboard. Further, the display device 2 may be any device as long as it has a touch panel and a short-range wireless communication function. For example, the display device 2 may be a tablet terminal, a notebook PC (Personal Computer), a PDA (Personal Digital Assistant), a game console, or the like.

Further, the display device 2 may be realized by a projector and a whiteboard without a touch panel. In this case, the projector uses a camera or sensor to detect the contact position of the input means.

The display device 2 displays the SSID (Service Set Identifier) and PIN (Personal Identification Number) required by the terminal device 30 for Wi-Fi communication, either automatically or in response to a user's operation. By inputting at least a PIN into the terminal device 30, the user can enable the terminal device 30 to communicate with the display device 2 via Wi-Fi.

The terminal device 30 is an information processing device having a position detection function and a wireless communication function. In the terminal device 30, a web browser and a dedicated application are installed to communicate with the display device 2. The user activates these and communicates with the display device 2. The terminal device 30 can transmit setting information such as electronic signature information to the display device 2.

<Device hardware configuration>
Next, the hardware configuration of the display device 2 will be explained using FIG. 4. The display device 2 has the configuration of an information processing device or a computer as shown in the figure. FIG. 4 is an example of a hardware configuration diagram of the display device 2. As shown in FIG. As shown in FIG. 4, the display device 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and an SSD (Solid State Drive) 204. ing.

Among these, the CPU 201 controls the operation of the display device 2 as a whole. The ROM 202 stores programs used to drive the CPU 201, such as the CPU 201 and an IPL (Initial Program Loader). RAM 203 is used as a work area for CPU 201.

The SSD 204 stores various data such as the OS and programs for the display device 2. This program may be an application program that runs on an information processing device equipped with a general-purpose OS (Windows (registered trademark), Mac OS (registered trademark), Android (registered trademark), iOS (registered trademark), etc.). In this case, the display device 2 is normally used as a general-purpose information processing device, but when the user runs an application program, the user can write by hand in the same way as the display device 2 is a dedicated device.

The display device 2 also includes a display controller 213, a touch sensor controller 215, a touch sensor 216, a display 220, a power switch 227, a tilt sensor 217, a serial interface 218, a speaker 219, a microphone 221, a wireless communication device 222, and an infrared I/F 223. , a power control circuit 224, an AC adapter 225, a battery 226, a power switch 227, and a USB interface 229.

The display controller 213 controls and manages screen display in order to output the output image to the display 220 or the like. The touch sensor 216 detects that the pen 2500, the user's hand, or the like (the pen or the user's hand serves as an input means) contacts the display 220. The touch sensor 216 also receives the pen ID.

Touch sensor controller 215 controls processing of touch sensor 216. The touch sensor 216 inputs and detects coordinates. The method of inputting the coordinates and detecting the coordinates will be explained. For example, in the case of an optical type, two light receiving and emitting devices installed at both ends of the upper side of the display 220 emit a plurality of infrared rays in parallel to the display 220. The two light receiving and emitting devices receive light that is reflected by a reflecting member provided around the display 220 and returns along the same optical path as the light path emitted by the light receiving element.

The touch sensor 216 outputs the position information of the infrared rays emitted by the two light receiving and emitting devices blocked by the object to the touch sensor controller 215, and the touch sensor controller 215 identifies the coordinate position that is the contact position of the object. Furthermore, the touch sensor controller 215 has a communication unit 215a and can communicate with the pen 2500 wirelessly. For example, when communicating using a standard such as Bluetooth (registered trademark), a commercially available pen can be used. By registering one or more pens 2500 in the communication unit 215a in advance, the user can communicate with the display device 2 without having to perform connection settings for communicating the pens 2500 with the display device 2.

The power switch 227 is a switch for switching the power of the display device 2 on and off. The tilt sensor 217 is a sensor that detects the tilt angle of the display device 2. Mainly used to detect whether the display device 2 is used horizontally, vertically, or horizontally, and to automatically change the thickness of characters, etc. according to the installation state. I can do it.

The serial interface 218 is a communication interface with an external device such as a USB. The serial interface 218 is used for inputting information from the outside. The speaker 219 is used for audio output, and the microphone 221 is used for audio input. The wireless communication device 222 communicates with a terminal carried by a user, and relays a connection to the Internet, for example. The wireless communication device 222 communicates using Wi-Fi, Bluetooth (registered trademark), etc., but the communication standard does not matter. The wireless communication device 222 forms an access point, and when the user sets the obtained SSID and password on the terminal carried by the user, the user can connect to the access point.

Note that the wireless communication device 222 is preferably provided with two access points.
a. Access point → Internet
b. Access point → Internal network → Internet Access point a is for users outside the company, and users cannot access the internal network but can use the Internet. Access point b is for internal users, who can use the internal network and the Internet.

The infrared I/F 223 detects the display device 2 placed next to it. The infrared I/F 223 can detect only the adjacent display device 2 by utilizing the straightness of infrared rays. Preferably, one infrared I/F 223 is provided on each side, and it is possible to detect in which direction of the display device 2 another display device 2 is arranged. As a result, the screen expands, and it is possible to display previously handwritten information (handwritten information on another page with the width of one display 220 as one page) etc. on the adjacent display device 2.

A power supply control circuit 224 controls an AC adapter 225 and a battery 226 that are power sources for the display device 2 . The AC adapter 225 converts alternating current shared by commercial power sources into direct current.

If the display 220 is a so-called electronic paper, it consumes little or no power to maintain image display, so it can also be driven by the battery 226. This makes it possible to use the display device 2 for applications such as digital signage even in places where it is difficult to connect to a power source, such as outdoors.

The USB interface 229 is an interface to which an external memory such as a USB memory 230 is attached.

Furthermore, the display device 2 includes a bus line 210. The bus line 210 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 201 shown in FIG. 4.

Note that the touch sensor 216 is not limited to an optical type, and may be a capacitive touch panel that identifies a touch position by detecting a change in capacitance. The touch sensor 216 may be a resistive touch panel that specifies the contact position based on voltage changes between two resistive films facing each other. The touch sensor 216 may be an electromagnetic induction type touch panel that detects electromagnetic induction generated when a touch object contacts the display section and specifies the contact position, or may use various detection means. The touch sensor 216 may be of a type that does not require an electronic pen to detect the presence or absence of a touch with the pen tip. In this case, you can use your fingertips or a pen-shaped stick to perform touch operations. Note that the pen 2500 does not need to be an elongated pen type.

<<Terminal device>>
The terminal device 30 in FIG. 3 is realized, for example, by a computer having the hardware configuration shown in FIG. 5. FIG. 5 is a hardware configuration diagram of an example of a computer. As shown in FIG. 5, the computer 700 includes a CPU 501, a ROM 502, a RAM 503, an HD 504, an HDD controller 505 (Hard Disk Drive), a display 506, an external device connection I/F 508 (Interface), a network I/F 509, and a bus. It includes a line 510, a keyboard 511, a pointing device 512, an optical drive 514, and a media I/F 516.

Among these, the CPU 501 controls the operation of the entire computer. The ROM 502 stores programs used to drive the CPU 501 such as IPL. RAM 503 is used as a work area for CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls reading and writing of various data to the HD 504 under the control of the CPU 501. The display 506 displays various information such as a cursor, menu, window, characters, or images. External device connection I/F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I/F 509 is an interface for data communication using a communication network. The bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 5.

Further, the keyboard 511 is a type of input means that includes a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The optical drive 514 controls reading and writing of various data to and from an optical storage medium 513, which is an example of a removable recording medium. The optical drive 514 is a CD, DVD, Blu-Ray (registered trademark), or the like. The media I/F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<About functions>
Next, the functions of the display device 2 and the terminal device 30 will be explained using FIG. 6. FIG. 6 is an example of a functional block diagram illustrating functions of the display device 2 and the terminal device 30 divided into blocks.

<<Display device>>
The display device 2 includes an input reception section 11, a drawing data generation section 12, a conversion section 13, a display control section 14, a data recording section 15, a communication section 16, an operation reception section 17, a command processing section 18, a web server function section 19, and an electronic signature section 20. Each function that the display device 2 has is a function that is realized by one of the components shown in FIG. It is a means.

The input receiving unit 11 detects the coordinates of a position where an input means such as the pen 2500 contacts the touch sensor 216, thereby receiving an input of a coordinate trajectory (coordinate point sequence, handwritten data). The drawing data generation unit 12 acquires the coordinates touched by the pen tip of the pen 2500 from the input reception unit 11. The drawing data generation unit 12 interpolates and connects this coordinate point sequence to generate stroke data.

The conversion unit 13 performs character recognition processing on one or more stroke data (handwritten data) handwritten by the user, and converts it into text (character code). The conversion unit 13 recognizes and converts characters (not only Japanese but also multiple languages such as English), numbers, and symbols (%, $, &, etc.) in parallel with the user's pen operations. Further, the conversion unit 13 performs a figure recognition process on one or more stroke data (handwritten data) handwritten by the user, and converts it into a figure (line, circle, triangle, etc.). Various algorithms have been devised for the recognition method, but in this embodiment, the details will be omitted because known techniques can be used.

The display control unit 14 causes the display to display handwritten data, character strings converted from the handwritten data, and operation menus for the user to operate.

The data recording unit 15 stores handwritten data handwritten on the display device 2, converted text, a PC screen, a file, etc. in the object storage unit 2001. Handwritten data, text (including graphics), images such as a PC screen, files, etc. are handled as objects. Regarding handwritten data, a set of stroke data becomes one object according to temporal divisions due to interruptions in handwriting and distance divisions due to differences in handwriting locations.

The communication unit 16 communicates with the terminal device 30 by short-range wireless communication such as Wi-Fi. Further, the communication unit 16 can also communicate by connecting to a wired LAN. The communication unit 16 can also connect to the Internet by using the communication function with a mobile phone base station that the terminal device 30 has (the terminal device 30 needs to support the tethering function). The communication unit 16 can share handwritten data, converted character strings, PC screens, files, etc. with other display devices 2 located at other locations.

The operation reception unit 17 receives user operations on the display device 2, such as selection of an operation menu and selection of character string candidates.

The command processing unit 18 executes processing related to operation commands. The command processing unit 18 determines whether or not the text converted by the conversion unit 13 partially matches the recognized character string of each operation command registered in the command definition data, and if the text partially matches the recognition character string of each operation command registered in the command definition data, the display control unit 24 The command is displayed on the operation guide 500. Note that partial match also includes complete match. Furthermore, the minimum number of characters that need to match in determining partial matching is set in advance. Note that the command processing unit 18 may determine whether the figure converted by the conversion unit 13 partially matches the recognition figure (preset figure) of each operation command registered in the command definition data. The command processing unit 18 is an example of a determining unit in the claims.

The web server function unit 19 provides the terminal device 30 with the functions of a web server (also referred to as an HTML server or a WWW server) and an application server. That is, the Web server function unit 19 interprets the HTTP request sent from the terminal device 30 and sends an HTTP response (Web page). Thereby, the terminal device 30 can display a web page. Note that the web server function unit 19 may execute a web application. While a web page is only a static web document, a web application can dynamically change objects in response to user requests.

The electronic signature unit 20 creates an electronic signature for the stored data. The electronic signature unit 20 is called, for example, by the command processing unit 18 or the like, encrypts the hash value of the stored data using a private key specified by hand by the user, and combines it with the stored data.

The display device 2 also has a storage unit 2000 constructed in the SSD 204, RAM 203, etc. shown in FIG. 4, and the storage unit 2000 includes an object storage unit 2001, a command definition data storage unit 2002, and an electronic An information storage unit 2003 is constructed.

FIG. 7 schematically shows objects held by the object storage unit 2001. Objects are various types of data displayed by the display device 2.

- The data ID item is identification information that identifies the object.

- The type item is the type of object, such as handwritten, text, figure, image, etc. Handwriting is stroke data (coordinate point sequence). Characters are character strings (character codes) converted from handwritten data. A figure is a geometric shape converted from handwritten data, such as a triangle or a square. The image is image data such as Jpeg, Png, or Tiff imported from a PC or the Internet.

-One screen of the display device 2 is called a page. The page item is the page number.

- The coordinate item indicates the position of the object with respect to a predetermined origin of the display device 2. The position of the object is, for example, the upper left vertex of the circumscribed rectangle of the object. For example, the coordinates are expressed in units of display pixels.

- The size item is the width and height of the circumscribed rectangle of the object.

- The electronic signature item is combined data (plaintext stored data, electronic signature, electronic certificate) that includes an electronic signature and electronic certificate for stored data. The saved data may be grouped in any unit, but for example, all pages converted to a PDF file are saved data. In the electronic signature field, a signer and combined data (plaintext storage data 51, electronic signature 53, and electronic certificate 52) are registered. That is, as an example of the combined data, "ABC" (code 51) handwritten by user A shown in FIG. 1, data encrypted from the hash value converted from "ABC" (electronic signature 53), The issued electronic certificate 52 is included. Note that the electronic signature may be created for each page or for each area arbitrarily selected by the user.

FIG. 8 schematically shows command definition data stored in the command definition data storage unit 2002. The command definition data defines an operation command for the user to instruct on the display device 2 in association with the recognized character string.

- The recognized character string item is a character string to be compared with the text obtained by character recognition by the conversion unit 13. For example, if the recognized character string is "shomei", "signature", or "shomei", the text obtained by character recognition by the conversion unit 13 is compared to see if it partially matches the recognized character string.

- The command name item is the name of the operation command displayed in the operation guide.

- The processing item indicates the content of the processing that the display device 2 performs when the operation command is selected by the user.

Note that operation commands related to signatures with command names such as "Sign information Sec-G" and "Sign "AAA" are added each time the user registers electronic signature information on the display device 2, as described later. Ru. By doing so, the display device 2 can display the command name including the abbreviation of the electronic signature information.

FIG. 9 schematically shows electronic signature information stored in the electronic signature information storage unit 2003. The electronic signature information is information for the display device 2 to create an electronic signature.

- In the signer and abbreviation field, the name and abbreviation of the user who registered the electronic signature information are registered. The user can set it arbitrarily as described below. The abbreviation set in the abbreviation field may become part of the command name as described above.

- In the private key field, the private key registered by the signer is registered.

・In the electronic certificate item, the electronic certificate issued by the certification authority is registered. A digital certificate includes a public key that corresponds to a private key.

<<Terminal device>>
The explanation will be given by returning to FIG. 6. The terminal device 30 includes a display control section 32, an operation reception section 33, and a communication section 34. Each function that the terminal device 30 has is a function that is realized by one of the components shown in FIG. It is a means. This program may be a web browser or an application dedicated to the display device 2.

The communication unit 34 communicates with the display device 2 through short-range wireless communication such as Wi-Fi. Note that the terminal device 30 can also communicate with a mobile phone base station and can connect to the Internet via a gateway provided by a mobile phone carrier.

The display control unit 32 causes the display to display a web page or a web application acquired from the web server function unit 19 in the display device 2. The operation accepting unit 33 accepts operations on the terminal device 30 via a web page, a web application, or the like.

<Registration of electronic signature information>
First, referring to FIG. 10, a description will be given of an operation in which a user registers electronic signature information. FIG. 10 shows an electronic signature information registration screen 120 displayed by the terminal device 30. In order to display the electronic signature information registration screen 120, the user sets the SSID and PIN (information for connecting to the access point) displayed by the display device 2 on the terminal device 30, and also sets the IP address of the display device 2. (See Figure 33).

Further, the user receives authentication from the display device 2 for registering electronic signature information. The user receives the screen information of the electronic signature information registration screen 120 from the Web server function section 19 of the display device 2 by inputting the ID and password into the terminal device 30 and transmitting them to the display device 2 . This prevents general users from arbitrarily registering electronic signature information, and allows only a predetermined administrator to register electronic signature information.

As shown in FIG. 10, the electronic signature information registration screen 120 includes a signature data field 121, a signer field 122, an abbreviation field 123, and a registration button 124.

- The signature data column 121 is a column in which the user drags and drops the signature data 125 (private key and electronic certificate) or specifies the signature data file. The signature data 125 is a private key and an electronic certificate.

- The signer field 122 is a field in which the user arbitrarily sets a signer. The signer may serve as identification information for a user to call electronic signature information.

- The abbreviation column 123 is a column in which the user arbitrarily sets the abbreviation of the signer. The abbreviation may be part of the name of the operation command. The abbreviation may serve as identification information for the user to call up the digital signature information.

- When the user presses the registration button 124, the information entered on the electronic signature information registration screen 120 is transmitted to the display device 2. The display device 2 receives this information and stores it in the electronic signature information storage unit 2003.

FIG. 11 is a flowchart showing a procedure in which the display device 2 receives registration of electronic signature information.

First, the Web server function section 19 of the display device 2 determines whether a request for the electronic signature information registration screen 120 has been received via the communication section 16 (S1).

When receiving a request for the electronic signature information registration screen 120, the Web server function unit 19 transmits the screen information for the electronic signature information registration screen 120 to the terminal device 30 that is the request source (S2).

The Web server function unit 19 of the display device 2 determines whether electronic signature information has been received via the communication unit 16 (S3).

If the electronic signature information is received (Yes in S3), the electronic signature unit 20 stores the received electronic signature information in the electronic signature information storage unit 2003 (S4). In addition, the command processing unit 18 registers a fixed character string such as “Shomei” and the signer as recognition character strings in the command definition data storage unit 2002, and registers the command name including the abbreviation and the content of the process. do.

<Management and deletion of electronic signature information>
Next, management and deletion of electronic signature information will be explained with reference to FIGS. 12 and 13. FIG. 12A shows an electronic signature information list screen 130 displayed by the terminal device 30. The user causes the terminal device 30 to communicate with the display device 2 to display the electronic signature information list screen 130. Note that displaying the electronic signature information list screen 130 requires authentication, similar to displaying the electronic signature information registration screen 120.

The electronic signature information list screen 130 displays a list 131 of electronic signature information registered in the display device 2. The electronic signature information list 131 includes, for example, the signers displayed in the signer column 122 in FIG. 10, but may also include abbreviations. The user cannot edit the signers in the electronic signature information list 131.

Further, the electronic signature information list screen 130 has a delete button 133 at the right end of the signer. The user can press or click the delete button 133 to delete the electronic signature information.

FIG. 12(b) shows a confirmation message 132 that is displayed when the delete button 133 is pressed. The confirmation message 132 asks, ``Do you want to delete the "AAA" signature data? ” message 134, a yes button 135, and a no button 136. When the Yes button 135 is pressed, the display device 2 deletes the electronic signature information from the electronic signature information storage unit 2003.

FIG. 13 is a flowchart showing a procedure in which the display device 2 accepts deletion of electronic signature information.

First, the Web server function section 19 of the display device 2 determines whether or not a request for an electronic signature information list screen has been received via the communication section 16 (S11).

If a request for the electronic signature information list screen is received (Yes in S11), the web server function unit 19 transmits the screen information of the electronic signature information list screen 130 to the terminal device 30 that is the request source (S12).

The Web server function unit 19 of the display device 2 determines whether a request to delete electronic signature information (including the signer) has been received via the communication unit 16 (S13).

If the electronic signature information deletion request is received (Yes in S13), the electronic signature unit 20 deletes the electronic signature information specified by the signer from the electronic signature information storage unit 2003 (S14).

<Electronic signature processing>
Next, with reference to FIGS. 14 to 16, a process in which the user requests the display device 2 for an electronic signature and the display device 2 creates the electronic signature will be described. There are cases where the display device 2 displays the signature field 110 in an initial state, and cases where the user causes the signature field 110 to be displayed. First, a case where the display device 2 displays the signature field 110 in the initial state will be described. The case where the display device 2 displays the signature field 110 in the initial state is a case where the signature field 110 is prepared in PDF data etc. displayed by the display device 2.

FIG. 14 is a diagram illustrating the transition of information displayed regarding the signature field 110. Note that the explanation of FIG. 14 partially overlaps with that of FIG.

FIG. 14(a) shows the signature field 110 displayed in the initial state. The signature field 110 displays placeholder text "Please sign here." When the signature field 110 is displayed, the electronic signature unit 20 acquires the fact that it is the signature field 110 and the position of the signature field 110.

As shown in FIG. 14(b), the user handwrites his/her electronic signature information in order to retrieve it. If the user is a member of the information security group, the user may handwrite "jo", for example. The display device 2 displays several character string candidates 114 on the operation guide 500 by character recognition of "jo". The character string candidates 114 include a text into which "jo" is converted, a kanji character which is predictively converted from this text, and the like. In FIG. 14(b), a character string candidate "Information Security Group" which is predictively converted from the text "JO" is displayed.

In addition, although the operation guide 500 is displayed in FIG. 14(b), since the handwritten data is originally written in the signature field 110, the handwritten data is often for making an electronic signature. Therefore, if a signer exists in the character string candidate 114, the display control unit 14 may display the operation guide 500 as shown in FIG. 14(c) without displaying the operation guide 500.

As shown in FIG. 14(c), when the user selects "Information Security Group" in the operation guide 500 with the pen 2500 in FIG. 14(b), "Information Security Group" is displayed in the signature field 110. When a new text is displayed, the electronic signature unit 20 determines whether the circumscribed rectangle of the text and the signature field 110 overlap at a ratio equal to or higher than a threshold value. If this condition is satisfied, the electronic signature unit 20 searches the electronic signature information storage unit 2003 for this text (information security group) since the text has been input in the signature field 110.

As shown in FIG. 14D, if the text input in the signature field 110 matches the signer in the electronic signature information storage section 2003, the display control section 14 displays a check mark 111 in the signature field 110. In this way, the check mark 111 indicates that electronic signatures are possible.

As shown in FIG. 14(e), when the user touches the check mark 111 with a pen, the display control unit 14 inverts the check mark 111. Further, the electronic signature unit 20 creates an electronic signature using electronic signature information associated with the text (“information security group”) input in the signature field 110.

Note that the text entered in the signature field 110 and the check mark 111 may remain displayed. This way, you will know that it has been signed and who signed it.

In this way, the user can create an electronic signature by handwriting in the signature field 110. If the user selects the character string candidate 114, text can be entered into the signature field 110. Therefore, the user does not have to switch between entering text and creating an electronic signature.

As shown in FIG. 14(f), if the text entered in the signature field 110 does not match the signer in the electronic signature information storage unit 2003, the display control unit 14 will display the message “No signature data has been registered. Please register.'' message 117 is displayed. The user can view the message 117 and register electronic signature information as described in FIG. 10.

FIG. 15 is a flowchart illustrating a process in which the display device 2 creates an electronic signature in response to handwriting on the signature field 110. The process in FIG. 15 starts when the display device 2 displays prepared PDF data or the like.

The electronic signature unit 20 determines whether the signer has entered text in the signature field 110 (S21). As described above, the electronic signature unit 20 determines whether the circumscribed rectangle of the text and the signature field 110 overlap at a ratio greater than or equal to a threshold value. If this condition is met, the electronic signature unit 20 searches the text entered in the signature field 110 using the signer in the electronic signature information storage unit 2003.

If the signer registered in the electronic signature information storage unit 2003 is entered in the signature field 110 (Yes in S21), the display control unit 14 displays a check mark 111 in the signature field 110 (S22).

The operation reception unit 17 determines whether or not the press of the check mark 111 has been accepted (S23).

When the operation reception unit 17 receives the press of the check mark 111 (Yes in S23), the display control unit 14 inverts the check mark 111. Further, the electronic signature unit 20 creates an electronic signature using the electronic signature information associated with the text input in the signature field 110 (S24).
The electronic signature unit 20 stores the saved data, the electronic signature, and the electronic certificate (collectively referred to as a document in the figure) in the object storage unit 2001 (S25).

FIG. 16 is a flowchart illustrating a process in which the electronic signature unit 20 determines whether or not the signer's text has been entered in the signature field 110.

The electronic signature unit 20 determines whether text has been entered in the signature field 110 (S41). Specifically, the electronic signature unit 20 determines whether the circumscribed rectangle of the text displayed by selecting it from the operation guide 500 and the signature field 110 overlap at a ratio equal to or higher than a threshold value. The electronic signature unit 20 may determine whether the signature field 110 overlaps the circumscribed rectangle of the handwritten data handwritten by the user.

If the determination in step S41 is Yes, the electronic signature unit 20 searches the text input in the signature field 110 using the signer in the electronic signature information storage unit 2003 (S42).

If the text entered in the signature field 110 matches the signer in the electronic signature information storage unit 2003 (Yes in S42), the electronic signature unit 20 displays a check mark 111 in the signature field 110 (S43).

Further, the operation reception unit 17 determines whether or not the press of the check mark 111 is accepted (S44). When the operation reception unit 17 receives the press of the check mark 111 (Yes in S44), the display control unit 14 inverts the check mark 111 (S47).

If the determination in step S42 is No, the display control unit 14 displays a message 117 indicating an error that an electronic signature is not possible around the signature field 110 (S45).

Further, the display control unit 14 erases the message 117 after a certain period of time has passed since the message was displayed (S46).

<Signature field display processing>
Next, display processing of the signature field 110 will be described with reference to FIGS. 17 and 18. Although the display device 2 does not display the signature field 110, if the user wishes to create an electronic signature, the signature field 110 can be displayed at will.

FIG. 17A shows an operation guide 500 including an operation command for displaying the signature field 110. As shown in FIG. 17(a), a user who wishes to apply an electronic signature inputs handwritten data 118 for displaying a signature field creation command 112 in order to display a signature field 110. In FIG. 17(a), the handwritten "Shome" is a part of the recognition character string (for example, Shome, signature, etc.) associated with the signature field creation command 112 and the signature execution command 113 in the command definition data. Match. The display control unit 14 causes the operation guide 500 to display a signature field creation command 112 "Create a signature field" and a signature execution command 113 "Sign "Information Sec-G"".

When the user selects the signature field creation command 112 with the pen 2500, the display control unit 14 displays the signature field 110. FIG. 17(b) shows the newly displayed signature field 110. The signature field 110 displays placeholder text "Please sign here." The processing after the signature field 110 is displayed may be the same as that in FIGS. 14 and 15.

The signature field 110 does not need to be surrounded by a frame line, and it is sufficient that it is clear that there is an area in which to sign. For example, the signature field 110 may be indicated only by an underline, between two ruled lines, or by color coding.

FIG. 18 is a flowchart illustrating a process in which the display device 2 newly displays the signature field 110. The process in FIG. 18 can be executed after the display device 2 is started.

First, the electronic signature unit 20 determines whether the signature field creation command 112 is selected (S51). That is, the electronic signature unit 20 determines whether the handwritten data has been converted into text that partially matches the recognized character string associated with the signature field creation command 112 in the command definition data. When handwritten data is converted into text that partially matches the recognized character string associated with the signature field creation command 112, the display control unit 14 displays the command name (“Create signature field”) associated with the recognized character string. ) is displayed on the operation guide 500.

When the signature field creation command 112 "Create a signature field" is selected, the display control unit 14 displays the signature field 110 of the initially set size by deleting the handwritten data converted into text ( S52).

The process after displaying the signature field 110 may be similar to the flowchart described in FIG. 15 (S53).

In this way, the user can arbitrarily display the signature field 110, and therefore can create an electronic signature for any saved data.

<Creating an electronic signature without using a signature field>
Further, the user can also create an electronic signature without using the signature field 110. Not using the signature field 110 may mean that the signature field 110 is not displayed at all, or that the user does not handwrite in the signature field 110 even if the signature field 110 is present. The user writes by hand in areas other than the signature field (other than the input field).

FIG. 19 shows an operation command for creating an electronic signature displayed on the display device 2 when the user does not use the signature field 110.

As shown in FIG. 19(a), the user handwrites handwritten data 141 "jo" in order to have the display device 2 create an electronic signature. The conversion unit 13 converts “jo” into text. The electronic signature unit 20 determines whether this text partially matches the recognized character string in the command definition data. The recognized character string of the command definition data includes "Jouhou security group" which partially matches "Jou". Therefore, the display control unit 14 causes the operation guide 500 to display the signature execution command 113 "Sign information Sec-G".

The display control unit 14 also causes the operation guide 500 to display a character string candidate 114 that is predictively converted from the text converted from "jo".

When the user selects the signature execution command 113 with the pen 2500 in the operation guide 500, the electronic signature section 20 stores the recognized character string (the security group) of the signature execution command 113 as the signer in the electronic signature information storage section 2003. Create an electronic signature using the electronic signature information provided.

FIG. 19(b) shows a message display field 142 indicating that an electronic signature has been created. A message display field 142 displays a signer 143 of the electronic signature information used to create the electronic signature and a message 144 indicating that the electronic signature has been created.

Note that if the user selects the character string candidate 114 with the pen 2500 in the operation guide 500, any text can be displayed.

In this way, the user can simply use the text converted from handwritten data for input, or can select the signature execution command 113 to create an electronic signature. There is no need for the user to switch modes. Note that in FIG. 19A, the user handwrites the handwritten data 141 "jou", but the handwritten content is not limited to text, and may be shapes such as circles or squares. The command processing unit 18, which is an example of a determining unit, determines whether the text or figure into which the handwritten content has been converted is a preset recognized character string or recognized figure. When the command processing unit 18 determines that the converted text or figure is a preset recognition character string or recognition figure, the display control unit 14 performs a conversion based on the preset recognition character string or recognition figure. An operation command or an electronic signature command, which is an example of a display component that accepts the creation of an electronic signature, is displayed. The electronic signature unit 20 creates an electronic signature when receiving a selection of an operation command or an electronic signature command, which is an example of a display component.

FIG. 20 is a flowchart illustrating a process in which the display device 2 creates an electronic signature without using the signature field 110.

The electronic signature unit 20 determines whether the selection of the signature execution command 113 has been accepted (S61). That is, the electronic signature unit 20 determines whether the text input in a field other than the signature field 110 partially matches the signer among the recognized character strings associated with the signature execution command 113. If this condition is satisfied, the display control unit 14 displays the signature execution command 113 on the operation guide 500, and determines whether the operation reception unit 17 has accepted the selection of the signature execution command 113. As shown in FIG. 19, the signature execution command 113 includes a signer.

If the signature execution command 113 is selected (Yes in S61), the electronic signature unit 20 creates an electronic signature using the electronic signature information associated with the signer included in the signature execution command 113 (S62).

<Main effects>
According to the display device 2 of this embodiment, creation of the signature field 110 and signature input can be realized by pen input. The user can simply use text converted from handwritten data for input, or select the Execute Signature command 113 to create an electronic signature, allowing the user to enter text and create an electronic signature. There is no need to switch. Users can easily create electronic signatures by executing commands, so they can create electronic signatures without reducing work efficiency.

In this embodiment, a display device 2 that adds not only an electronic signature but also time stamp information to saved data will be described. The time stamp information is the hash value of the stored data to which a time certification authority has added time information.

Note that this embodiment will be described on the assumption that the hardware configuration diagrams shown in FIGS. 4 and 5 and the functional block diagram shown in FIG. 6 described in the above embodiments can be used.

FIG. 21 shows a system configuration diagram when the display device 2 uses the time stamp server 160. The display device 2 requests time stamp information from the time stamp server 160 and transmits the hash value of the stored data. The display device 2 attaches time information to the hash value and transmits it to the display device 2.

<Registering the time stamp server URL>
FIG. 22 shows a URL setting screen 150 displayed by the terminal device 30 when the user sets the URL of the time stamp server 160 on the display device 2. The terminal device 30 connects to the display device 2 and requests the URL setting screen 150. The Web server function unit 19 of the display device 2 transmits screen information of the URL setting screen 150 to the terminal device 30.

The URL setting screen 150 has a URL input field 151 and a registration button 152. The user sets the URL of the known time stamp server 160 in advance in the URL input field 151, and presses the registration button 152. Since the terminal device 30 transmits the URL to the display device 2, the electronic signature section 20 stores it in the storage section 2000.

FIG. 23 is a flowchart illustrating a process in which the display device 2 receives the setting of the URL of the time stamp server 160.

First, the Web server function section 19 of the display device 2 determines whether a request for the URL setting screen 150 has been received via the communication section 16 (S71).

If a request for the URL setting screen 150 is received (Yes in S71), the web server function unit 19 transmits the screen information for the URL setting screen 150 to the terminal device 30 that is the request source (S72).

The Web server function unit 19 of the display device 2 determines whether the URL of the time stamp server 160 has been received via the communication unit 16 (S73).

If the URL of the time stamp server 160 is received (Yes in S73), the digital signature unit 20 stores the received URL of the time stamp server 160 in the storage unit 2000 (S74).

<Electronic signature processing>
FIG. 24 is a flowchart illustrating a process in which a time stamp is added to the process in which the display device 2 creates an electronic signature. Although the description of FIG. 24 will start with the signature field 110 being displayed, the signature field 110 may not be provided.

The electronic signature unit 20 determines whether the signer has entered text in the signature field 110 (S31). As described above, the electronic signature unit 20 determines whether the circumscribed rectangle of the text and the signature field 110 overlap at a ratio greater than or equal to a threshold value. If this condition is satisfied, the electronic signature unit 20 searches the electronic signature information storage unit 2003 for the text input in the signature field 110.

If the signer is entered in text (Yes in S31), the display control unit 14 displays a check mark 111 in the signature field 110 (S32).

The operation reception unit 17 determines whether or not the press of the check mark 111 has been accepted (S33).

When the operation receiving unit 17 receives the press of the check mark 111 (Yes in S33), the display control unit 14 inverts the check mark 111. Further, the electronic signature unit 20 creates an electronic signature using the electronic signature information associated with the text input in the signature field 110 (S34), and stores it in the object storage unit 2001 (S35).

The electronic signature unit 20 obtains time stamp information from the time stamp server 160 via the communication unit 16 (S36).

The electronic signature section 20 adds time stamp information in association with the electronic signature of step S35 and stores it in the object storage section 2001 (S37).

<Main effects>
According to this embodiment, in addition to the effects of the first embodiment, the display device 2 can additionally store time stamp information in the digital signature.

In this embodiment, an electronic signature system 170 in which an electronic signature server 171 on a network creates an electronic signature will be described.

FIG. 25 shows a schematic system configuration diagram of the electronic signature system 170. The electronic signature system 170 includes an electronic signature server 171, an authentication server 172, and a display device 2. Further, the terminal device 30 can communicate with the electronic signature server 171, the authentication server 172, and the display device 2 via the network N, either wirelessly or by wire.

The electronic signature server 171 is one or more information processing devices. Upon receiving the request from the display device 2 and the hash value of the stored data, the electronic signature server 171 creates an electronic signature and returns it to the display device 2. Electronic signature information has already been registered in the electronic signature server 171 from the terminal device 30 as in the first embodiment. Note that commercial services such as box.com/sign are known as the electronic signature server 171, but any service may be used as the electronic signature server 171.

Authentication server 172 is one or more information processing devices. The authentication server 172 is a server that authenticates users in order to use the electronic signature server 171. The user connects the terminal device 30 to the authentication server 172 and registers the user ID, password, etc. When the display device 2 uses the electronic signature server 171, if the authentication by the authentication server 172 is successful, the electronic signature server 171 can be used. Note that the user registered in the authentication server 172 can also register the display device 2 that becomes the user of the electronic signature server 171. When the display device 2 is registered, the display device 2 can use the electronic signature server 171 regardless of the user who is currently using it.

Note that the authentication server 172 and the electronic signature server 171 may be integrated. All or part of the functions of the authentication server 172 and the digital signature server 171 may exist in a cloud environment or may exist in an on-premises environment.

The terminal device 30 and the display device 2 may be the same as those in the first embodiment. However, the display device 2 of this embodiment does not need to have the function of creating an electronic signature.

<About functions>
FIG. 26 is an example of a functional block diagram illustrating functions of the display device 2, electronic signature server 171, and terminal device 30 divided into blocks. Note that in the explanation of FIG. 26, differences from FIG. 6 will be mainly explained. The function of the authentication server 172 will be omitted as it has a known authentication function.

<<Display device>>
The display device 2 does not have the electronic signature section 20 and the electronic signature information storage section 2003 in contrast to FIG. 6 . This is because the electronic signature server 171 has these functions. The display device 2 has an electronic signature identification information storage section 2004 instead of the electronic signature information storage section 2003. Other functions may be the same as those in FIG.

FIG. 27 shows the electronic signature identification information stored in the electronic signature identification information storage unit 2004. Electronic signature identification information is abbreviated as signer, which has the function of identification information among electronic signature information. At least some of these are used by the display device 2 to specify electronic signature information to the electronic signature server 171.

Further, since the display device 2 synchronizes the electronic signature identification information with the electronic signature server 171, the display device 2 acquires the electronic signature identification information from the electronic signature server 171 at a fixed timing, such as once a day.

<<Electronic signature server>>
The electronic signature server 171 includes a communication section 181 and an electronic signature section 20. Each function of the electronic signature server 171 is realized by one of the components shown in FIG. or means.

The communication unit 181 receives from the display device 2 a request to create an electronic signature specifying the electronic signature information and the hash value of the saved data. Furthermore, the communication unit 181 transmits the created electronic signature to the display device 2.

The electronic signature unit 20 uses the electronic signature information specified by the display device 2 to create an electronic signature for the hash value of the stored data.

Further, the electronic signature server 171 has a storage section 183 constructed in the HD 504, RAM 503, etc. shown in FIG. 5, and an electronic signature information storage section 2003 is constructed in the storage section 183. The configuration of the electronic signature information storage unit 2003 may be the same as that in FIG. 9 of the first embodiment.

<Electronic signature creation process>
Next, with reference to FIG. 28, the flow of processing in which the electronic signature system 170 creates an electronic signature will be described. FIG. 28 is a sequence diagram illustrating a process in which the electronic signature system 170 of this embodiment creates an electronic signature in response to a request from the display device 2.

S81: The operation reception unit 17 of the display device 2 accepts creation of an electronic signature. That is, the text entered in the signature field 110 matches the signer in the electronic signature identification information storage section 2004, or the signature execution command 113 is displayed due to the text entered in a field other than the signature field 110, and the signature execution command 113 is displayed. is selected. Therefore, the signer is identified.

S82: The communication unit 16 of the display device 2 first specifies the user ID and password and sends an authentication request to the authentication server 172 in order to receive authentication. The user ID and password may be input by the user when logging into the display device 2, or may be set on the display device 2.

S83: The authentication server 172 receives the authentication request and authenticates the user based on the user ID and password. Here, it is assumed that the authentication was successful. The authentication server 172 transmits a token indicating successful authentication to the display device 2. The token includes the authority that this user can use on the electronic signature server 171.

S84: When the communication unit 16 of the display device 2 receives the token, the communication unit 16 specifies the token, the signer, and the hash value of the stored data and transmits an electronic signature creation request to the electronic signature server 171.

S85: The communication unit 181 of the electronic signature server 171 receives the electronic signature creation request and determines that the user authentication has been successful based on the token. The electronic signature unit 20 creates an electronic signature by encrypting the hash value transmitted from the display device 2 using electronic signature information associated with the signer.

S86: The communication unit 181 of the electronic signature server 171 transmits the electronic signature and the electronic certificate associated with the signer to the display device 2.

S87: When the communication unit 16 of the display device 2 receives the electronic signature and the electronic certificate, the data recording unit 15 combines the electronic signature with the saved data and stores it in the object storage unit 2001 together with the electronic certificate. Note that time stamp information may be further added.

<Main effects>
According to this embodiment, in addition to the effects of the first and second embodiments, the display device 2 can create an electronic signature by requesting the electronic signature server 171. Therefore, each display device 2 does not need to have electronic signature information or the electronic signature section 20.

In this embodiment, on the premise that a user logs into the display device 2, a description will be given of the display device 2 that determines whether or not the user can use electronic certificate information. In the first embodiment, any user who wrote the signer by hand could create an electronic signature, but in this embodiment, the users who create electronic signatures can be restricted. For example, it is possible to prevent a user from creating an electronic signature using someone else's electronic signature information.

<About functions>
FIG. 29 is an example of a functional block diagram illustrating functions of the display device 2 and the terminal device 30 divided into blocks. Note that in the explanation of FIG. 29, differences from FIG. 6 will be mainly explained.

<<Display device>>
The display device 2 newly includes an authentication section 21. The authentication unit 21 authenticates the user based on a preset user ID and password or the user's signature. A user who has been successfully authenticated can log in to the display device 2. Note that this user authentication function may be located within the display device 2 or may be located on the network.

<Registration of electronic signature information>
FIG. 30 shows the electronic signature information registration screen 120 of this embodiment. In the explanation of FIG. 30, differences from FIG. 10 will be mainly explained. In FIG. 30, there is no signer field 122, and a signer 126 is displayed when the Web server function unit 19 transmits the screen information of the electronic signature information registration screen 120 to the display device 2. This signer 126 is the name of the user specified by the user logging into the display device 2 from the terminal device 30.

In this way, the name of the logged-in user is automatically set as the signer 126 of the electronic signature information. Therefore, when an arbitrary user uses the display device 2 and logs into the display device 2, the name is identified, and the display device 2 creates an electronic signature only if this name matches the signer. be able to.

<Log in to the display device>
An example of a method for a user to log in to the display device 2 will be described with reference to FIGS. 31 and 32. FIG. 31 shows operation commands etc. displayed by the display device 2 at the time of login. FIG. 31(a) shows operation commands displayed for handwritten data 191 input by the user. A user who wishes to log in enters handwritten data 191 for displaying a login command. In FIG. 31(a), the text converted from the handwritten "Logu" partially matches the recognized character string (for example, Login, Login, etc.) associated with the login command in the command definition data. The display control unit 14 displays a login command 192 called "Login".

As shown in FIG. 31(b), when the user selects the login command 192, the display control unit 14 displays a user ID field 194 and a password field 195. In the user ID column 194, placeholder text "Login ID" is displayed. In the password field 195, placeholder text "Password" is displayed. The authentication unit 21 compares the registered user ID and password with the input user ID and password, and if they match, it can identify the user's name.

Note that the display device 2 can use a signature as authentication information. As shown in FIG. 31(c), when the user selects the login command 192, the display control unit 14 displays a signature input field 196. In the signature input field 196, placeholder text "Enter signature for signature authentication" is displayed. The user handwrites his or her name in the signature input field 196. The signature of the user's name is registered in advance in the display device 2 in association with the user's name, and the authentication unit 21 compares the feature amount of the registered signature with the feature amount of the input signature, and if the signature matches the threshold value or more, Can identify the user's name.

FIG. 32 shows another example of operation commands etc. displayed by the display device 2 at the time of login. As will be explained with reference to FIG. 32, when a user logs in, fields such as those shown in FIGS. 31(b) and 31(c) are not necessarily necessary.

FIG. 32(a) shows operation commands displayed for handwritten data input by the user. A user who wishes to log in enters handwritten data 198 to display a login command. In FIG. 32A, the feature amount of the handwritten signature of "Ichiro Suzuki" matches the preset feature amount of the signature of the user "Ichiro Suzuki" by a threshold value or more. Therefore, the display control unit 14 displays the login command 193 "Login 'Ichiro Suzuki'".

As shown in FIG. 32(b), when the user selects the login command 193 with the pen 2500, login is accepted (authentication is successful when the signatures match). The display control unit 14 displays a message 197 indicating that the login has been completed.

In this way, users can log in simply by handwriting their name. If the user selects the character string candidate 114 with the pen 2500, the user can also input a name.

<Electronic signature creation process after login>
When a user logs in to the display device 2, since the user has been specified, the user can create an electronic signature using his or her electronic signature information simply by pressing the icon. Note that an electronic signature can also be created using the same method as in Examples 1 to 3.

FIG. 33 shows an example of an input screen 600 displayed by the display device 2. The input screen 600 mainly includes a handwriting area 601, a menu button 602, a zoom pan window display 603, a page number display 604, a page navigation display 605, and an information display area 606.

The handwriting area 601 is an area where the user arbitrarily writes by hand with the pen 2500. Handwritten data is automatically converted to character strings. Handwritten data may be converted into a character string by a user's operation.

The menu button 602 includes icons for the user to select a handwritten data line type 602a, line color 602b, undo 602c, redo 602d, ghost removal 602e, electronic signature icon 602f, handwriting recognition 602g, deletion 602h, and the like.
- The handwritten data line type 602a is an icon that accepts changes to the line type (thickness, solid line, dotted line, etc.) of handwritten data.
- Line color 602b is an icon for accepting changes in the color of handwritten data. In the case of electronic paper, monochrome is the mainstream, so differences in color are represented by line types.
- Cancel 602c is an icon that accepts cancellation of the last input operation.
- Redo 602d is an icon that accepts an operation to re-execute the canceled operation.
・Ghost removal 602e is used to remove ghosts (gray object traces that remain after being completely erased) that occur with electronic paper, so the display device 2 initializes the entire screen and removes the object before pressing ghost removal 602e. This is an icon that accepts an operation to redisplay the .
- The electronic signature icon 602f is an icon that accepts creation of an electronic signature.
-Handwriting recognition 602g is an icon that accepts character recognition for handwritten data.
- Delete 602h is an icon that accepts an operation to delete the currently displayed page or a part of it (move it to the trash can).

The zoom pan window display 603 is an icon that accepts operations to zoom (enlarge) or pan (reduce) the handwritten area.

A page number display 604 indicates what page the current handwritten data is. A page navigation display 605 is a button for displaying thumbnails of each page at the right end of the handwriting area.

The information display area 606 is an area that displays today's date 606a, time 606b, IP address 606c, SSID 606d, PIN 606e, and the like. The IP address 606c is an IP address for connecting the terminal device 30 to the display device 2. The SSID 606d is an identifier of an access point provided by the display device 2. The PIN 606e is an encryption key (password) for connecting the terminal device 30 to the access point. The PIN 606e may be displayed separately from the encryption key (password). Security can be improved by using different encryption keys and PINs.

The user inputs this IP address 606c into a web browser running on the terminal device 30. Furthermore, the user can transmit the IP address 606c to a user at a remote location, and can have a remote conference with another display device 2 or perform connected display with an adjacent display device 2.

FIG. 34(a) shows a signature execution dialog 300 that is displayed when the digital signature icon 602f is pressed. The signature execution dialog 300 displays the message "Do you want to sign with 'Ichiro Suzuki'?" ” message 301, a yes button 302, and a no button 303. "Ichiro Suzuki" is the name of the logged-in user. When the user presses the yes button 302, the electronic signature unit 20 creates an electronic signature using electronic signature information with "Ichiro Suzuki" as the signer. FIG. 34(b) shows a message 304 displayed by the display device 2 that created the electronic signature.

In this way, an authenticated signer is also registered when electronic signature information is registered, and by logging in to the display device 2, the user can create an electronic signature by pressing the icon.

<Suppression of creating electronic signatures using someone else's electronic signature information>
A description will be given of how, by a user logging into the display device 2, creation of an electronic signature using someone else's electronic signature information can be suppressed.

For example, even if Mr. Tanaka logs into the display device 2 and handwrites "Ichiro Suzuki" and converts it to text, the check mark 111 will not be displayed in FIG. 14 because the name of the logged-in user and the signer do not match. , FIG. 17, and FIG. 19, the signature execution command 113 is not displayed. Further, even if Mr. Tanaka presses the electronic signature icon 602f, Mr. Tanaka can only create an electronic signature using electronic signature information with Mr. Tanaka as the signer.

FIG. 35 is a flowchart illustrating the process by which the display device 2 creates an electronic signature in this embodiment. In the explanation of FIG. 35, the user may handwrite in the signature field 110 or in a place other than the signature field.

First, the authentication unit 21 of the display device 2 authenticates the user (S91). A user who has been successfully authenticated logs into the display device 2.

When the user writes handwritten data, the conversion unit 13 converts the handwritten data into text.

(1) A case where handwriting is written in the signature field 110 will be explained. The electronic signature unit 20 determines whether the text handwritten in the signature field 110 and selected by the operation guide 500 partially matches the signer in the electronic signature information storage unit 2003 (S92).

If the determination in step S92 is Yes, the electronic signature unit 20 determines whether the signer identified in step S92 and the logged-in user are the same (S93).

(2) A case where handwriting is written in a field other than the signature field 110 will be explained. It is assumed that the text converted from the handwritten data partially matches the recognized character string of the signature execution command 113. The electronic signature unit 20 determines whether the recognized character string of the signature execution command 113 partially matches the signer in the electronic signature information storage unit 2003 (S92).

If the determination in step S92 is Yes, the electronic signature unit 20 determines whether the signer identified in step S92 and the logged-in user are the same (S93).

If the determination in step S93 is Yes, the display control unit 14 displays a check mark 111 in the signature field 110 shown in FIG. 14, or sends a signature execution command 113 to the operation guide 500 as shown in FIG. Display it (S94).

If the determination in step S92 or S93 is No, the display control unit 14 displays only the text recognition result in the signature field 110, or displays only the character string candidate 114 in the operation guide 500 (S95). That is, the display control unit 14 does not display the signature execution command 113 that accepts execution of an electronic signature.

Although FIG. 35 describes a case where the display device 2 creates an electronic signature, this embodiment can be similarly applied to a case where the electronic signature server 171 creates an electronic signature as in the third embodiment. That is, in step S95, the display control unit 14 does not display a message to accept the execution of an electronic signature, so the display device 2 does not request the electronic signature server 171 for an electronic signature.

<Main effects>
According to this embodiment, in addition to the effects of embodiments 1 to 3, the display device 2 can restrict users who create electronic signatures. For example, it is possible to prevent a user from creating an electronic signature using someone else's electronic signature information.

In this embodiment, a display device 2 that automatically creates an electronic signature will be described. For example, if it is required by law to attach an electronic signature to an electronic document, it is possible to prevent the electronic signature from being missing.

<About functions>
FIG. 36 is an example of a functional block diagram illustrating functions of the display device 2 and the terminal device 30 divided into blocks. Note that in the explanation of FIG. 36, differences from FIG. 6 will be mainly explained.

<<Display device>>
The display device 2 newly includes an electronic signature creation timing determining section 22. The electronic signature creation timing determination section 22 determines whether or not it is the timing to automatically create an electronic signature, and when this timing comes, requests the electronic signature section 20 to create an electronic signature.

<Process of automatically creating an electronic signature>
FIG. 37 is a flowchart illustrating the process by which the display device 2 automatically creates an electronic signature.

The electronic signature creation timing determination unit 22 initializes the elapsed time t to 0 when the electronic signature is created last (S101).

The electronic signature creation timing determining unit 22 determines whether the elapsed time t exceeds a preset time threshold T (S102).

If the determination in step S102 is No, the electronic signature creation timing determining unit 22 increases the elapsed time t by a predetermined amount (S103). The predetermined amount may be a value corresponding to the determination cycle of step S103, and may be, for example, about 1 second.

If the determination in step S102 is Yes, the electronic signature creation timing determining unit 22 requests the electronic signature unit 20 to create an electronic signature for the saved data using the electronic signature information of the signer specified in advance. The electronic signature unit 20 creates electronic signatures for all stored data stored in the object storage unit 2001 (S104). Note that the signer specified in advance may be an administrator or the like.

Since the electronic signature has been created, the electronic signature creation timing determining unit 22 initializes the elapsed time t to 0 (S105).

<Main effects>
According to this embodiment, in addition to the effects of embodiments 1 to 4, the display device 2 can automatically create an electronic signature.

In this embodiment, a remote communication system 310 will be described in which a plurality of display devices 2 that communicate remotely share an electronic signature.

FIG. 38 shows a system configuration diagram of the remote communication system 310 in this embodiment. The remote communication system 310 includes an intermediary server 8 and a plurality of display devices 2A and 2B that can communicate via a network.

The handwritten data input to the display device 2A is transmitted in real time to the mediation server 8, and the mediation server 8 transmits it to the display device 2B. The handwritten data input to the display device 2B is transmitted in real time to the mediation server 8, and the mediation server 8 transmits it to the display device 2A. By doing so, the plurality of display devices 2A and 2B can share the object, and users in remote locations can hold a conference using the object displayed on the display device 2.

<About functions>
FIG. 39 is an example of a functional block diagram of the mediation server 8. Note that the hardware block diagram of the mediation server 8 may be the same as that in FIG. 5. The mediation server 8 includes a communication section 401, a sharing section 402, and an object storage section 403. The communication unit 401 communicates with the display devices 2A and 2B, and transmits objects and electronic signatures from one display device 2 to the other display device 2.

The sharing unit 402 manages the display devices 2 connected to the same session, and performs a process of sharing objects between the display devices 2 connected to the same session. The display device 2A and the display device 2B connect to the same session by connecting to the URL issued by the mediation server 8. A sharing unit 402 of the mediation server 8 shares objects such as handwritten data among a plurality of display devices 2 connected to the same session.

Note that data may be transmitted and received between the display devices 2A and 2B using a communication method such as WebRTC (Web Real Time Communication), without using the intermediary server 8.

The object storage unit 403 stores objects such as handwritten data and text together with position information on the display 220. Objects are associated with session IDs. The session ID is identification information of the session in which the object is shared. The configuration of the object storage unit 403 may be the same as that of the object storage unit 2001 included in the display device 2. However, an electronic signature is not required.

<Share electronic signature>
FIG. 40 is a sequence diagram illustrating a process in which the display devices 2A and 2B share an electronic signature with an object.

S301, S302: The input reception unit 11 of the display device 2A accepts creation of an electronic signature. The electronic signature unit 20 creates an electronic signature for the saved data.

S303: The communication unit 16 of the display device 2A transmits the object (for real-time sharing), stored data (for example, PDF file), and electronic signature (including the electronic certificate) to the intermediary server 8.

S304: The communication unit 401 of the mediation server 8 receives the object, the saved data, and the electronic signature, and the sharing unit 402 stores the object in the object storage unit 403.

S305: The communication unit 401 of the mediation server 8 transmits the object, saved data, and electronic signature to the display device 2B. Note that the display device 2A at the base A and the display device 2B at the headquarters are connected to the same session.

S306: The communication unit 16 of the display device 2B receives the object, the saved data, and the electronic signature, and the display control unit 14 displays the object.

S307: The electronic signature unit 20 of the display device 2B verifies the electronic signature. That is, the electronic signature unit 20 obtains a hash value of the saved data and compares it with the hash value obtained by decrypting the electronic signature using the public key included in the electronic certificate. If the verification is successful, it is determined that the stored data has not been tampered with and is stored in the object storage unit 2001. By doing so, it is guaranteed that the saved data saved by the display device 2B is the same as that of the display device 2A.

<Main effects>
According to this embodiment, in addition to the effects of embodiments 1 to 5, a plurality of display devices 2 that communicate remotely can share unaltered stored data based on electronic signatures.

In this embodiment, a display device 2 that creates an electronic signature when storing an object in a USB memory or the like will be described.

In this embodiment, the hardware configuration diagrams shown in FIGS. 4 and 5 and the functional block diagram shown in FIG. 6 described in the above embodiments can be used.

As shown in FIG. 41, the command definition data in this embodiment is different from that in the first embodiment. FIG. 41 schematically shows command definition data stored in the command definition data storage unit 2002 in this embodiment. In the explanation of FIG. 41, differences from FIG. 8 will be mainly explained. In the command definition data of this embodiment, "USB" is registered as a recognized character string. The command names are "Save to USB memory" and "Sign and save to USB memory 'login user'". The process of ``Save to USB memory'' is ``Save the saved data to USB'', and the process of ``Sign and save on USB memory 'login user''' is ``Sign and save data to USB memory'. Create a digital signature using the information and save it on a USB.

Therefore, when the user handwrites USB, these operation commands are displayed on the operation guide 500.

FIG. 42 shows an example of the signature execution command of this embodiment. As shown in FIG. 42, a user who wants to save an electronic signature in the USB memory 230 inputs handwritten data 321 for that purpose. In FIG. 42, the handwritten "USB" partially matches the recognized character string (eg, USB, etc.) associated with the save execution command 322 in the command definition data. The display control unit 14 causes the operation guide 500 to display a signature execution command 323 "Save document in USB memory".

Similarly, the handwritten "USB" partially matches the recognized character string (eg, USB, etc.) associated with the signature execution command 323 in the command definition data. Since the signature execution command 323 requires a logged-in user, the display control unit 14 acquires the logged-in user. Assume that the current logged-in user is "Ichiro Suzuki." Therefore, the display control unit 14 causes the operation guide 500 to display the signature execution command 323 "Sign and save on USB memory 'Ichiro Suzuki'".

When the user selects the signature execution command 323, the electronic signature unit 20 creates an electronic signature using the electronic signature information associated with the logged-in user "Ichiro Suzuki."

Note that the save execution command 322 and signature execution command 323 in FIG. 42 may be displayed only when the USB memory 230 is connected to the display device 2.

FIG. 43 is a flowchart illustrating a process in which the display device 2 creates an electronic signature and stores it in a USB memory.

First, the electronic signature unit 20 determines whether handwritten data has been converted into text that partially matches the recognized character string associated with the signature execution command in the command definition data (S111). If the determination in step S111 is Yes, the display control unit 14 displays command names associated with the recognized character string ("Save document in USB memory", "Sign and save in USB memory 'Ichiro Suzuki'") as an operational guide. 500 (S112).

When the signature execution command 323 "Sign and save on USB memory 'Ichiro Suzuki'" is selected, the electronic signature section 20 creates an electronic signature using the electronic signature information associated with "Ichiro Suzuki". (S113).

The electronic signature unit 20 stores the saved data to which the electronic signature has been added in the USB memory 230 (S114).

<Main effects>
According to this embodiment, in addition to the effects of embodiments 1 to 6, the user can create an electronic signature and save it in the external memory by handwriting the name of the external memory.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using examples, the present invention is not limited to these examples in any way, and various modifications can be made without departing from the gist of the present invention. and substitutions can be added.

For example, in this embodiment, the display device 2 creates the electronic signature, but the display device 2 may simply encrypt the object. For example, when a user handwrites ``angou'' (angou), operation commands are displayed and the object can be encrypted. The decryption procedure may be similar.

In addition, in this embodiment, the stroke data is mainly converted into Japanese, but the languages to which the stroke data is converted are other languages (English, Chinese, Hindu, Spanish, French, Arabic, Russian). (words, etc.) are acceptable.

Further, although the present embodiment has been described using an electronic blackboard as an example, the electronic blackboard may be called an electronic whiteboard, an electronic information board, or the like. Further, this embodiment can be suitably applied to any information processing device having a touch panel. Information processing devices equipped with touch panels include, for example, projectors, output devices such as digital signage, HUD (Head Up Display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, network home appliances, notebook PCs, and mobile phones. , a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

Further, in this embodiment, the coordinates of the pen tip are detected by a method of detecting the coordinates of the pen tip using a touch panel, but the display device 2 may detect the coordinates of the pen tip using ultrasonic waves. Further, the pen emits ultrasonic waves as well as emits light, and the display device 2 calculates the distance based on the arrival time of the ultrasonic waves. The display device 2 can specify the position of the pen based on the direction and distance, and the projector draws (projects) the trajectory of the pen as stroke data.

Further, in the configuration example shown in FIG. 6 and the like, the display device 2 is divided according to main functions in order to facilitate understanding of the processing performed by the display device 2. The present invention is not limited by the method of dividing the processing units or the names thereof. The processing of the display device 2 can also be divided into more processing units depending on the processing content. Furthermore, one processing unit can be divided to include more processing.

Moreover, each function of the embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules.
Embodiments of the present invention provide significant improvements in computer power and functionality. These improvements enable users to utilize computers that provide more efficient and robust interaction with tables, the way information is stored and presented in information processing devices. Additionally, embodiments of the present invention provide a better user experience through the use of a more efficient, powerful, and robust user interface. Such user interfaces provide better interaction between humans and machines.
<Additional notes regarding claims>
[Claim 1]
A display device that displays handwriting as an object,
an input reception unit that accepts the handwritten input;
a conversion unit that converts the handwritten text into text or figures;
a determination unit that determines whether the converted text or figure is a preset recognized character string or recognized figure;
When the determination unit determines that the converted text or figure is the preset recognized character string or the recognized figure, create an electronic signature based on the preset recognized character string or recognized figure. a display control unit that displays accepted display components;
an electronic signature section that creates the electronic signature when the selection of the display component is accepted;
A display device having:
[Claim 2]
The input reception unit accepts the handwritten input entered in an input field other than the input field displayed for the electronic signature,
The conversion unit converts the handwritten text into text or figures,
The display device according to claim 1, wherein the display control unit displays the display component based on the text or graphic.
[Claim 3]
In definition data in which a preset recognized character string and the display component are associated, when the text converted from the handwritten text by the conversion unit partially matches the recognized character string,
The display control unit displays the display component associated with the partially matched recognized character string,
3. The display device according to claim 1, wherein the display component accepts creation of an electronic signature.
[Claim 4]
The recognition character string includes signer information,
When the text converted from the handwritten text by the conversion unit partially matches the signer information,
4. The display device according to claim 3, wherein the display control unit displays the partially matched signer information together with the display component.
[Claim 5]
When the selection of the display component displayed together with the signer information is accepted,
The electronic signature unit obtains electronic signature information associated with the signer information from an electronic signature information storage unit in which electronic signature information is associated with the signer information, and creates an electronic signature for the object. The display device according to claim 4, characterized in that:
[Claim 6]
It has an authentication section that authenticates users,
The text converted from the handwritten text by the conversion unit partially matches the signer information, and further,
If the user who has been successfully authenticated by the authentication unit matches the signer information,
5. The display device according to claim 4, wherein the display control unit displays the partially matched signer information together with the display component.
[Claim 7]
If the handwritten text is entered in the input field displayed for electronic signature,
The display control unit is characterized in that, in accordance with the text or figure converted from the handwritten text by the conversion unit, the text or figure is displayed in the input field, and a message indicating that an electronic signature is possible is displayed. The display device according to claim 1.
[Claim 8]
The display control unit displays the text or figure converted from the handwritten text by the conversion unit,
8. The display device according to claim 7, wherein when the selection of the text is accepted, the display control unit displays a message indicating that an electronic signature is possible.
[Claim 9]
If the electronic signature section receives the selection that the electronic signature is possible, the electronic signature section creates an electronic signature regarding the object using the electronic signature information associated with the text converted from the handwritten text by the conversion section. The display device according to claim 7 or 8, wherein a display device is created.
[Claim 10]
In the electronic signature information storage unit that stores electronic signature information in association with signer information,
When the text converted from the handwritten text by the conversion unit partially matches the signer information,
The display device according to claim 7 or 8, wherein the display control unit displays the text converted from the handwritten text by the conversion unit in the input field, and displays that an electronic signature is possible. .
[Claim 11]
It has an authentication section that authenticates users,
The text converted from the handwritten text by the conversion unit partially matches the signer information, and further,
If the user who has been successfully authenticated by the authentication unit matches the signer information,
11. The display device according to claim 10, wherein the display control unit displays a message indicating that an electronic signature is possible together with the text converted from the handwritten text by the conversion unit.
[Claim 12]
The input reception unit accepts the handwritten input entered in an input field other than the input field displayed for the electronic signature,
the converting unit converts the handwritten text into text or figures; the display control unit displays the input field based on the text or figure converted from the handwritten text input in a field other than the input field;
The display device according to any one of claims 7 to 9, wherein the input accepting unit accepts the handwritten input to the newly displayed input field.
[Claim 13]
It has an authentication section that authenticates users,
If you accept the selection of an icon that accepts the creation of an electronic signature,
The electronic signature section stores the electronic signature information associated with the signer information in the electronic signature information storage section that stores the electronic signature information associated with the signer information, and uses the electronic signature information associated with the user who has been successfully authenticated by the authentication section to authenticate the object. The display device according to claim 1, wherein the display device creates an electronic signature regarding.
[Claim 14]
14. The display device according to claim 1, wherein the electronic signature unit automatically creates an electronic signature for the object each time an elapsed time exceeds a time threshold.
[Claim 15]
When the text converted from the handwritten text by the conversion unit partially matches the recognized character string including a preset name of an external memory,
The display control unit displays a display component that creates an electronic signature and stores the electronic signature in the external memory,
4. The display device according to claim 3, wherein when the selection of the display component is accepted, the electronic signature section creates an electronic signature regarding the object and stores it in the external memory.
[Claim 16]
16. The display device according to claim 1, wherein the electronic signature section adds time stamp information to the electronic signature.

2 Display device

JP 2017-123077 Publication

Claims (19)

A display device that displays handwriting as an object,
an input reception unit that accepts the handwritten input;
a conversion unit that converts the handwritten text into text or figures;
a determination unit that determines whether the converted text or figure is a preset recognized character string or recognized figure;
When the determination unit determines that the converted text or figure is the preset recognized character string or the recognized figure, create an electronic signature based on the preset recognized character string or recognized figure. a display control unit that displays accepted display components;
an electronic signature section that creates the electronic signature when the selection of the display component is accepted;
A display device having: The input reception unit accepts the handwritten input entered in an input field other than the input field displayed for the electronic signature,
The conversion unit converts the handwritten text into text or figures,
The display device according to claim 1, wherein the display control unit displays the display component based on the text or graphic. In definition data in which a preset recognized character string and the display component are associated, when the text converted from the handwritten text by the conversion unit partially matches the recognized character string,
The display control unit displays the display component associated with the partially matched recognized character string,
3. The display device according to claim 1, wherein the display component accepts creation of an electronic signature. The recognition character string includes signer information,
When the text converted from the handwritten text by the conversion unit partially matches the signer information,
4. The display device according to claim 3, wherein the display control unit displays the partially matched signer information together with the display component. When the selection of the display component displayed together with the signer information is accepted,
The electronic signature unit obtains electronic signature information associated with the signer information from an electronic signature information storage unit in which electronic signature information is associated with the signer information, and creates an electronic signature for the object. The display device according to claim 4, characterized in that: It has an authentication section that authenticates users,
The text converted from the handwritten text by the conversion unit partially matches the signer information, and further,
If the user who has been successfully authenticated by the authentication unit matches the signer information,
5. The display device according to claim 4, wherein the display control unit displays the partially matched signer information together with the display component. If the handwritten text is entered in the input field displayed for electronic signature,
The display control unit is characterized in that, in accordance with the text or figure converted from the handwritten text by the conversion unit, the text or figure is displayed in the input field, and a message indicating that an electronic signature is possible is displayed. The display device according to claim 1. The display control unit displays the text or figure converted from the handwritten text by the conversion unit,
8. The display device according to claim 7, wherein when the selection of the text is accepted, the display control unit displays a message indicating that an electronic signature is possible. If the electronic signature section receives the selection that the electronic signature is possible, the electronic signature section creates an electronic signature regarding the object using the electronic signature information associated with the text converted from the handwritten text by the conversion section. The display device according to claim 7 or 8, wherein a display device is created. In the electronic signature information storage unit that stores electronic signature information in association with signer information,
When the text converted from the handwritten text by the conversion unit partially matches the signer information,
The display device according to claim 7 or 8, wherein the display control unit displays the text converted from the handwritten text by the conversion unit in the input field, and displays that an electronic signature is possible. . It has an authentication section that authenticates users,
The text converted from the handwritten text by the conversion unit partially matches the signer information, and further,
If the user who has been successfully authenticated by the authentication unit matches the signer information,
11. The display device according to claim 10, wherein the display control unit displays a message indicating that an electronic signature is possible together with the text converted from the handwritten text by the conversion unit. The input reception unit accepts the handwritten input entered in an input field other than the input field displayed for the electronic signature,
the converting unit converts the handwritten text into text or figures; the display control unit displays the input field based on the text or figure converted from the handwritten text input in a field other than the input field;
8. The display device according to claim 7, wherein the input accepting unit accepts the handwritten input to the newly displayed input field. It has an authentication section that authenticates users,
If you accept the selection of an icon that accepts the creation of an electronic signature,
The electronic signature section stores the electronic signature information associated with the signer information in the electronic signature information storage section that stores the electronic signature information associated with the signer information, and uses the electronic signature information associated with the user who has been successfully authenticated by the authentication section to authenticate the object. The display device according to claim 1, wherein the display device creates an electronic signature regarding. The display device according to claim 1, wherein the electronic signature unit automatically creates an electronic signature regarding the object every time an elapsed time exceeds a time threshold. When the text converted from the handwritten text by the conversion unit partially matches the recognized character string including a preset name of an external memory,
The display control unit displays a display component that creates an electronic signature and stores the electronic signature in the external memory,
4. The display device according to claim 3, wherein when the selection of the display component is accepted, the electronic signature section creates an electronic signature regarding the object and stores it in the external memory. The display device according to claim 1, wherein the electronic signature section adds time stamp information to the electronic signature. An electronic signature method performed by a display device that displays handwritten text as an object, the method comprising:
an input reception unit accepting the handwritten input;
a conversion unit converting the handwritten text into text or drawings;
a step in which the determining unit determines whether the converted text or figure is a preset recognized character string or recognized figure;
When the determination unit determines that the converted text or figure is the preset recognized character string or recognized figure, create an electronic signature based on the preset recognized character string or recognized figure. a step of displaying an accepted display component;
When the electronic signature unit receives the selection of the display component, creating the electronic signature;
An electronic signature method. A display device that displays handwritten text as an object.
an input reception unit that accepts the handwritten input;
a conversion unit that converts the handwritten text into text or figures;
a determination unit that determines whether the converted text or figure is a preset recognized character string or recognized figure;
When the determination unit determines that the converted text or figure is the preset recognized character string or recognized figure, create an electronic signature based on the preset recognized character string or recognized figure. a display control unit that displays accepted display components;
an electronic signature unit that creates the electronic signature when the selection of the display component is accepted;
A program to function as An electronic signature system comprising a display device that displays handwritten text as an object and an electronic signature server, the electronic signature system comprising:
The display device includes:
an input reception unit that accepts handwritten input;
a conversion unit that converts the handwritten text into text or figures;
a determination unit that determines whether the converted text or figure is a preset recognized character string or recognized figure;
When the determination unit determines that the converted text or figure is the preset recognized character string or recognized figure, create an electronic signature based on the preset recognized character string or recognized figure. a display control unit that displays accepted display components;
a communication unit that transmits a request to create the electronic signature to the electronic signature server when the selection of the display component is accepted;
The electronic signature server is
An electronic signature system characterized in that when receiving the electronic signature creation request, the electronic signature is created and transmitted to the display device.

Images