JP7383959B2 - Display device, usage providing method, program, image processing system - Google Patents

Description

The present invention relates to a display device, a method for providing a usage method, a program, and an image processing system.

2. Description of the Related Art Display devices that display data handwritten with a pen or finger on a touch panel are known. A display device equipped with a relatively large touch panel is placed in a conference room or the like and shared by multiple users as an electronic whiteboard or the like.

As display devices are becoming more sophisticated and multi-functional, techniques have been devised to change the functions that can be used depending on the user (for example, see Patent Document 1). Patent Document 1 discloses a display device that associates a user with each touch pen and changes available functions depending on the touch pen used by the user.

However, the conventional technology has a problem in that there may be a large number of functions that the user does not use. When a display device is shared, users are not always able to use it for their own use, making it easy for users to have functions that they do not use. Further, if the user is using the display device for the first time, there is a possibility that the user does not know the existence of the function.

SUMMARY OF THE INVENTION In view of the above problems, an object of the present invention is to provide a display device and the like that can reduce the number of functions that are not used by a user.

In view of the above problems, the present invention provides a display device that identifies a user through external or internal authentication, and in which whether or not the user has used a function is determined based on function usage history information recorded for each function. , a provision control unit that provides a usage method for a function that is used less than a predetermined frequency by a user, and the provision control unit provides information that the function is used and that the usage method of the function is provided. The present invention is characterized in that each function is recorded in the function usage history information, and a method of using the function that the user has never used and for which a method of using the function is not provided is provided.

It is an object of the present invention to provide a display device or the like that can reduce functions that are not used by a user.

FIG. 2 is a diagram illustrating an outline of the operation of the display device according to the present embodiment. 1 is an example of an overall configuration diagram of an image processing system. 1 is an example of a hardware configuration diagram of a display device. It is an example of a hardware configuration diagram of an account server. 1 is an example of a functional block diagram of a display device. It is a conceptual diagram of page data. FIG. 3 is a conceptual diagram showing stroke array data. FIG. 3 is a conceptual diagram showing coordinate array data. FIG. 3 is a conceptual diagram showing media data. It is a figure showing a UI image (A), a stroke image (B), an output image (C), and a background image (D). FIG. 2 is an example of a functional block diagram illustrating functions of an account server divided into blocks. FIG. FIG. 2 is a diagram schematically showing information stored in an authentication information DB. FIG. 2 is an example of a functional block diagram illustrating functions of a display device related to tutorial display control divided into blocks; FIG. FIG. 3 is a diagram showing an example of a function usage history table stored in a function usage history DB. It is a diagram showing an example of teaching material data stored in a teaching material data DB. FIG. 3 is a diagram showing an example of a tutorial provision setting screen. It is an example of a sequence diagram explaining the procedure from login to update of function usage rate. FIG. 3 is an example of a flowchart illustrating a process in which a display device provides a tutorial; FIG. FIG. 11 is an example of a flowchart for determining the order in which tutorials are provided for functions that have not been used by a user and for which no tutorials are provided; FIG. FIG. 7 is an example of a flowchart illustrating a procedure in which the provision control unit determines the functions for which tutorials are to be continuously provided; FIG. FIG. 3 is a diagram illustrating a display example of a tutorial displayed on a display of a display device. This is an example of an icon list including icons that call functions with a high function usage rate. FIG. 3 is an example of a flowchart showing a procedure in which the display control unit displays a function call icon. FIG. It is a figure which shows the other example of a structure of a display apparatus. It is a figure which shows the other example of a structure of a display apparatus. It is a figure which shows the other example of a structure of a display apparatus. It is a figure which shows the other example of a structure of a display apparatus.

Hereinafter, as an example of a mode for carrying out the present invention, a display device and a method for providing a usage method performed by the display device will be described.

<Outline of operation of display device>
FIG. 1 is a diagram illustrating an outline of the operation of the display device 2 of this embodiment. A display device 2 is installed in a conference room or the like, and the display device 2 is shared by a plurality of users.

(1) A user who mainly operates the display device 2, such as a presenter, logs into the display device 2. Login refers to the authentication act of accessing system resources using pre-registered account information when using a computer or various services on the Internet. Authentication means that the display device 2 or the like determines whether the user is a legitimate authorized person. If the authentication is successful, the user can log in to the display device 2. Account information includes, but is not limited to, a user ID and password, an IC card number, biometric information, and the like.

(2) When a user logs in, the display device 2 displays a tutorial for functions that are used infrequently by this user. A tutorial is a teaching material that helps users learn the basic operating methods of application software and the like. Display device 2 records the functions used by each user and whether tutorials are provided in a function usage history table (an example of function usage history information), which will be described later. You can view tutorials for features you've never seen before.

(3) The display device 2 displays the tutorial determined based on the function usage history table to the logged-in user. For example, the contents of functions that can be selected using on-screen icons are displayed in text and images (including videos).

By following the tutorial and pressing the icons, the user can try out functions that are rarely used. Since users have just logged in, they can use the same icons provided with the tutorial even in the meeting, making it easier to remember the functionality. In this way, the display device 2 of this embodiment can reduce the number of functions that the user does not use.

<About terms>
Function is the unique role of each factor that is interconnected and makes up the whole. Examples include processes executed by icons, buttons (soft keys), switches (hard keys), etc., included in the display device. There may be a one-to-one correspondence between the units of tutorial provision and functions, or one tutorial may cover multiple functions.

The frequency of use by a user is the degree to which the same function is used. The frequency may be calculated using an index such as the number of times or a rate, but is not limited to these.

How to use a function is how to use the function, and is information in a format that can be understood by humans. Also called operating method. This embodiment will be explained using the term "tutorial." It may also be called a manual, guide, help, instruction manual, etc.

<System overview>
FIG. 2 is an overall configuration diagram of the image processing system 1 of this embodiment. In addition, in order to simplify the explanation, FIG. 2 only shows two display devices 2a, 2b and accompanying electronic pens 4a, 4b, etc. You may also use a pen, etc.

As shown in FIG. 2, the image processing system 1 includes a plurality of display devices 2a and 2b, a plurality of electronic pens 4a and 4b, USB memories 5a and 5b, notebook PCs (Personal Computers) 6a and 6b, and a television ( Video) It has conference terminals 7a, 7b, and a PC8. Further, the display devices 2a, 2b and the PC 8 are communicably connected via a communication network 9. Furthermore, the plurality of display devices 2a and 2b are provided with displays 3a and 3b, respectively.The display device 2a also displays events caused by the electronic pen 4a (the nib of the electronic pen 4a on the display 3a, or An image drawn by a touch of the pen end of the electronic pen 4a can be displayed on the display 3a. Note that the image displayed on the display 3a can be changed based not only on the electronic pen 4a but also on events (gestures such as enlarging, reducing, page turning, etc.) caused by the user's hand Ha including fingers. can.

Further, a USB memory 5a can be connected to the display device 2a, and the display device 2a can read electronic files such as PDF from the USB memory 5a, and the display device 2a can record electronic files in the USB memory 5a. Can be done. In addition, the display device 2a is connected to the notebook via a cable 10a1 capable of communication according to standards such as DisplayPort, DVI (Digital Visual Interface), HDMI (registered trademark. High-Definition Multimedia Interface), and VGA (Video Graphics Array). PC6a is connected. Then, the display device 2a generates an event by contacting the display 3a, and transmits event information indicating this event to the notebook PC 6a in the same way as an event from an input device such as a mouse or a keyboard. Similarly, a television (video) conference terminal 7a is connected to the display device 2a via a cable 10a2 capable of communication according to the above standard. Note that the notebook PC 6a and the video conference terminal 7a may communicate with the display device 2a by wireless communication based on various wireless communication protocols such as Bluetooth (registered trademark).

On the other hand, at other bases where the display device 2b is installed, the display device 2b equipped with the display 3b, the electronic pen 4b, the USB memory 5b, the notebook PC 6b, the video conference terminal 7b, the cable 10b1, the cable 10b2 is used. Furthermore, the image displayed on the display 3b can be changed based on an event caused by the user's hand Hb or the like.

As a result, an image drawn on the display 3a of the display device 2a at one location is also displayed on the display 3b of the display device 2b at another location, and conversely, an image drawn on the display 3b of the display device 2b at another location. The image drawn in is displayed on the display 3a of the display device 2a at one location. In this way, the image processing system 1 can perform remote sharing processing in which the same image is shared in a remote location, so it is very convenient to use it for a conference or the like in a remote location.

In addition, below, when indicating an arbitrary display device among a plurality of display devices, it will be referred to as "display device 2." When indicating an arbitrary display among a plurality of displays, it is indicated as "display 3." When indicating an arbitrary electronic pen among a plurality of electronic pens, it is indicated as "electronic pen 4." When indicating an arbitrary USB memory among a plurality of USB memories, it is indicated as "USB memory 5." When indicating an arbitrary notebook PC among the plurality of notebook PCs, it is indicated as "notebook PC6." When indicating an arbitrary teleconference terminal among the plurality of teleconference terminals, it is indicated as "teleconference terminal 7." Moreover, when indicating an arbitrary hand among a plurality of users' hands, it is indicated as "hand H". When indicating an arbitrary cable among a plurality of cables, it is indicated as "cable 10."

In addition, in this embodiment, an electronic blackboard will be described as an example of a display device, but the present invention is not limited to this. Other examples of display devices include electronic signboards (digital signage), those used for sports, weather forecasts, etc. It may be a telestrator, a remote image (video) diagnostic device, or the like. In addition, a notebook PC 6 will be described as an example of an information processing terminal, but the information processing terminal is not limited to this. Other examples of information processing terminals include a desktop PC, a tablet PC, a PDA, a digital video camera, a digital camera, a game computer, etc. The terminal may be a terminal capable of supplying image frames such as a machine. Furthermore, the communication network includes the Internet, LAN (Local Area Network), mobile phone communication network, and the like. Further, in this embodiment, a USB memory will be described as an example of a recording medium, but the present invention is not limited to this, and various recording media such as an SD card may be used as other examples of the recording medium.

An account server 8 is connected to the communication network 9. The account server 8 is a server that manages user accounts. An example of the account server 8 is an LDAP (Lightweight Directory Access Protocol) server. LDAP is a protocol for connecting to a directory service that manages information on network devices, users, etc. A directory service is a service that centrally manages various information existing on a network and provides search and other functions. The client (display device 2 in this embodiment) connects to the LDAP server using TCP port 389 (default port number), and configures the data by attributes (department, personal name, etc. in the case of an in-house directory). Perform operations such as searching, adding, deleting, and modifying entries (groups of related attributes).

For example, if the user IDs and passwords of multiple services are registered together as attributes of one user ID, each service can perform authentication by referring only to the LDAP server. Administrators can also manage information centrally, reducing the hassle of changing user information in each service's directory.

LDAP servers include open software such as OpenLDAP and commercial software such as Microsoft's Active Directory (registered trademark).

<Hardware configuration of display device>
Next, the hardware configuration of the display device of this embodiment will be explained using FIG. 3. Note that FIG. 3 is a hardware configuration diagram of the display device.

As shown in FIG. 3, the display device 2 includes a CPU 101 that controls the overall operation of the display device 2, a ROM 102 that stores programs used to drive the CPU 101 such as IPL, and a RAM 103 that is used as a work area for the CPU 101. , an SSD 204 that stores various data such as programs for the display device 2, a network controller 105 that controls communication with the communication network 9, and an external storage controller 106 that controls communication with the USB memory 5.

The display device 2 also includes a capture device 111 that displays video information as a still image or a video on the display of the notebook PC 6, a GPU (Graphics Processing Unit) 112 that specializes in graphics, and a display that displays output images from the GPU. A display controller 113 is provided for controlling and managing screen display for output to 3 and the video conference terminal 7.

Furthermore, the display device 2 includes a sensor controller 114 that controls the processing of the contact sensor 115, and a contact sensor 115 that detects when the electronic pen 4, the user's hand H, or the like comes into contact with the display 3. This contact sensor 115 performs coordinate input and coordinate detection using an infrared cutoff method. This method of inputting and detecting coordinates is such that two light receiving and emitting devices installed at both ends of the upper side of the display 3 emit multiple infrared rays in parallel to the display 3. This is a method of receiving light that is reflected by a reflecting member and returns along the same optical path as the light emitted by the light receiving element. The contact sensor 115 outputs the ID (Identification) of the infrared rays emitted by the two light receiving and emitting devices blocked by the object to the sensor controller 114, and the sensor controller 114 identifies the coordinate position that is the contact position of the object. Note that all the IDs shown below are examples of identification information.

In addition, the contact sensor 115 is not limited to the infrared cutoff type, but may also include a capacitive touch panel that identifies the touch position by detecting changes in capacitance, and a touch panel that identifies the touch position by voltage changes in two opposing resistive films. Various detection means may be used, such as a resistive film type touch panel for specifying, an electromagnetic induction type touch panel for detecting electromagnetic induction generated when a touch object contacts the display section, and specifying the contact position.

The display device 2 also includes an electronic pen controller 116. The electronic pen controller 116 communicates with the electronic pen 4 to determine whether the display 3 has been touched with the tip of the pen or the tail of the pen. Note that the electronic pen controller 116 may determine whether or not a portion of the electronic pen 4 that the user grips, or other portions of the electronic pen, is touched, in addition to the pen tip and pen tail of the electronic pen 4.

Furthermore, the display device 2 includes a CPU 101, a ROM 102, a RAM 103, an SSD 104, a network controller 105, an external storage controller 106, a capture device 111, a GPU 112, a sensor controller 114, and an electronic pen controller 116, as shown in FIG. A bus line 120 such as an address bus or a data bus is provided for electrical connection.

Note that the program for the display device 2 may be recorded on a computer-readable recording medium such as a CD-ROM and distributed.

<Example hardware configuration of account server>
FIG. 4 is a hardware configuration diagram of the account server 8. The account server 8 is constructed by a computer, and as shown in FIG. ) 508, a network I/F 509, a bus line 510, a keyboard 511, a pointing device 512, a DVD-RW (Digital Versatile Disk Rewritable) drive 514, and a media I/F 516.

Among these, the CPU 501 controls the operation of the account server 8 as a whole. The ROM 502 stores programs used to drive the CPU 501 such as IPL. RAM 503 is used as a work area for CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls reading and writing of various data to the HD 504 under the control of the CPU 501. The display 506 displays various information such as a cursor, menu, window, characters, or images. External device connection I/F 508 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I/F 509 is an interface for data communication using the communication network 9. The bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.

Further, the keyboard 511 is a type of input means that includes a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device 512 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 514 controls reading and writing of various data on a DVD-RW 513, which is an example of a removable recording medium. Note that it is not limited to DVD-RW, but may be DVD-R or the like. The media I/F 516 controls reading or writing (storage) of data to a recording medium 515 such as a flash memory.

<Functional configuration of display device>
Next, the functional configuration of the display device 2 will be explained using FIGS. 5 to 10. Note that first, the overall functional configuration of the display device 2 will be explained using FIG. 5. FIG. 5 is a functional block diagram of the display device 2. As shown in FIG.

The display device 2 has the functional configuration shown in FIG. 5 using the hardware configuration and program shown in FIG. 3. The display device 2 can be a "host device" that starts the remote sharing process first, and can also be a "participating device" that later participates in the remote sharing process that has already started. Furthermore, the display device 2 is broadly divided into both a client section 20 and a server section 90. The client section 20 and the server section 90 are functions realized within one housing of the display device 2. When the display device 2 serves as a host device, the display device 2 implements a client section 20 and a server section 90. Further, when the display device 2 becomes a participating device, the client unit 20 is implemented in the display device 2, but the server unit 90 is not implemented. That is, in FIG. 2, when the display device 2a is the host device and the display device 2b is the participating device, the client unit 20 of the display device 2a communicates with others via the server unit 90 implemented within the same display device 2a. It communicates with the client section 20 of the display device 2b. On the other hand, the client section 20 of the display device 2b communicates with the client section of the other display device 2a via the server section 90 implemented in the other display device 2a.

<<Functional configuration of client section>>
Next, the functional configuration of the client section 20 will be described mainly using FIG. 5. The client unit 20 includes a video acquisition unit 21 , a coordinate detection unit 22 , an automatic adjustment unit 23 , a contact detection unit 24 , an event distribution unit 25 , an operation processing unit 26 , a gesture processing unit 27 , a video superimposition unit 28 , and an image processing unit 30 , and a communication control section 60.

Among these, the video acquisition unit 21 acquires the output video of the video output device connected to the cable 10. When the video acquisition unit 21 receives an image signal from a video output device, it analyzes this image signal and determines the resolution of an image frame that is a display image of the video output device formed by this image signal and updates of this image frame. Image information such as frequency is derived and output to the image acquisition unit 31.

The coordinate detection unit 22 detects the coordinate position of an event caused by the user on the display 3 (such as an action in which the user's hand H touches the display 3). The coordinate detection unit 22 also detects the touched area.

The automatic adjustment unit 23 is activated when the display device 2 is started, and adjusts the image processing parameters of the sensor camera in the optical sensor method of the contact sensor 115 so that the contact sensor 115 can output an appropriate value to the coordinate detection unit 22. do.

The contact detection unit 24 detects an event caused by the user (such as an operation in which the tip of the electronic pen 4 or the pen tail of the electronic pen 4 is pressed down (touched) on the display 3).

The event sorting section 25 sorts the coordinate position of the event detected by the coordinate detecting section 22 and the detection result detected by the contact detecting section 24 into events of stroke drawing, UI operation, and gesture operation.

Here, "stroke drawing" means that when a stroke image (B) shown in FIG. 10 and described later is displayed on the display 3, the user presses the electronic pen 4 on the display 3, and this press This is an event in which the electronic pen 4 is moved in this state until it is finally released from the display 3. By this stroke drawing, for example, the alphabet "S", "T", etc. are drawn on the display 3. Note that this "stroke drawing" includes not only drawing an image, but also events such as deleting an already drawn image and editing a drawn image.

“UI operation” is an event in which the user presses a predetermined position with the electronic pen 4 or hand H when the UI image (A) shown in FIG. 10 and described later is displayed on the display 3. . Through this UI operation, for example, the color and width of the line drawn by the electronic pen 4 are set.

“Gesture operation” is an event in which the user touches or moves on the display 3 with the hand H when the stroke image (B) shown in FIG. 10 and described later is displayed on the display 3. be. With this gesture operation, for example, by touching the display 3 with the hand H and moving the hand H, the user can enlarge (or reduce) the image, change the display area, or switch pages. can.

The operation processing unit 26 executes various operations based on the UI element determined to be a UI operation by the event distribution unit 25, according to the UI element in which the event occurred. Examples of the elements of this UI include buttons, lists, check boxes, and text boxes.
The gesture processing unit 27 executes an operation corresponding to the gesture operation determined by the event distribution unit 25.

The video superimposing unit 28 displays an image superimposed by a display superimposing unit 36 (described later) as a video on a video output device (such as the display 3). Further, the video superimposing unit 28 performs picture-in-picture on the video sent from another video output device (such as the television conference terminal 7) with respect to the video from the video output device (such as the notebook PC 6). Furthermore, the video superimposing unit 28 performs switching to display the video that has been picture-in-pictured on a portion of the display 3 on the entire display 3.

The image processing unit 30 performs superimposition processing of each image layer as shown in FIG. 10, and the like. The image processing section 30 includes an image acquisition section 31, a stroke processing section 32, a UI image generation section 33, a background generation section 34, a layout management section 35, a display superimposition section 36, a page processing section 37, a file processing section 40, and a page data processing section 37. It has a storage unit 300 and a remote license management table 310.

Among these, the image acquisition unit 31 acquires each frame as an image from the video acquired by the video acquisition unit 21. The image acquisition unit 31 outputs this image data to the page processing unit 37. This image corresponds to the output image (C) from the video output device (notebook PC 6, etc.) shown in FIG.

The stroke processing section 32 draws an image, deletes a drawn image, or edits a drawn image based on an event related to stroke drawing assigned by the event distribution section 25. The image created by this stroke drawing corresponds to the stroke image (B) shown in FIG. 10. Further, the results of image drawing, deletion, and editing based on this stroke drawing are stored in the operation data storage unit 840 as operation data to be described later.

The UI image generation unit 33 generates a UI (user interface) image that is preset on the display device 2. This UI image corresponds to the UI image (A) shown in FIG. 10.

The background generation unit 34 receives media data from the page data read out from the page data storage unit 300 by the page processing unit 37 . The background generation unit 34 outputs the received media data to the display superimposition unit 36. Further, the image based on this media data corresponds to the background image (D) shown in FIG. 10. The pattern of the background image (D) is a plain color, a grid display, or the like.

The layout management unit 35 sends layout information indicating the layout of each image output from the image acquisition unit 31, stroke processing unit 32, and UI image generation unit 33 (or background generation unit 34) to the display superimposition unit 36. Managed. Thereby, the layout management unit 35 instructs the display superimposition unit 36 to determine where in the UI image (A) and background image (D) the output image (C) and the stroke image (B) are to be displayed. You can instruct whether to hide it.

The display superimposition unit 36 creates the layout of each image output from the image acquisition unit 31, stroke processing unit 32, and UI image generation unit 33 (background generation unit 34) based on the layout information output from the layout management unit 35. conduct.

The page processing unit 37 stores the data of the stroke image (B) and the data of the output image (C) into one page data in the page data storage unit 300. The data of the stroke image (B) forms part of the page data as stroke array data (each stroke data) indicated by the stroke array data ID shown in FIG. The data of the output image (C) forms part of the page data as media data indicated by the media data ID shown in FIG. When this media data is read from the page data storage unit 300, it is treated as background image (D) data.

In addition, the page processing unit 37 sends the media data of the page data once stored to the display superimposition unit 36 via the background generation unit 34, so that the video superimposition unit 28 displays the background image (D). 3 can be redisplayed. Further, the page processing unit 37 can return the stroke arrangement data (each stroke data) of the page data to the stroke processing unit 32, thereby making it possible to re-edit the strokes. Furthermore, the page processing unit 37 can also delete or copy page data.

That is, the data of the output image (C) displayed on the display 3 at the time when the page processing unit 37 stores the page data in the page data storage unit 300 is temporarily stored in the page data storage unit 300, and then When read from the page data storage unit 300, it is read as media data indicating the background image (D). Then, the page processing section 37 outputs stroke array data indicating the stroke image (B) among the page data read from the page data storage section 300 to the stroke processing section 32. Furthermore, the page processing unit 37 outputs media data indicating the background image (D) out of the page data read from the page data storage unit 300 to the background generation unit 34.

The display superimposition unit 36 outputs an output image (C) from the image acquisition unit 31, a stroke image (B) from the stroke processing unit 32, a UI image (A) from the UI image generation unit 33, and an output image from the background generation unit 34. The background image (D) is superimposed according to the layout specified by the layout management section 35. As a result, as shown in FIG. 10, even if the images overlap, the UI image (A), stroke image (B), output image (C), and background image (D) are displayed in the order in which the user sees them. It is composed of Leia.

The display superimposing unit 36 can also switch between image (C) and image (D) shown in FIG. 10 and superimpose them exclusively on image (A) and image (B). . For example, if the cable 10 between the display device 2 and the video output device (notebook PC 6, etc.) is disconnected while images (A), (B), and (C) are initially being displayed, , it is possible to remove image (C) from the superimposition target and display image (D) according to the designation of the layout management unit 35. In this case, the display superimposition unit 36 also performs display enlargement, display reduction, and display area movement processing.

The page data storage unit 300 stores page data as shown in FIG. FIG. 6 is a conceptual diagram showing page data. The page data is data for one page (stroke array data (each stroke data) and media data) displayed on the display 3. Note that since there are many types of parameters included in the page data, the contents of the page data will be explained here with reference to FIGS. 6 to 9.

As shown in Figure 6, the page data includes a page data ID for identifying any one page, a start time indicating the time when this page started being displayed, and rewriting of page contents by strokes, gestures, etc. An end time indicating the time at which the stroke is no longer performed, a stroke array data ID for identifying stroke array data generated by strokes by the electronic pen 4 or the user's hand H, and a media data ID for identifying the media data are associated. is memorized. The stroke array data is data for displaying a stroke image (B) shown in FIG. 10, which will be described later, on the display 3. The media data is data for displaying a background image (D) shown in 16, which will be described later, on the display 3.

With such page data, for example, when the user draws the alphabet "S" with the electronic pen 4, it is written in one stroke, so one stroke data ID indicates one letter of the alphabet [S]. However, when the user draws the alphabet "T" with the electronic pen 4, it is written in two strokes, so one alphabet "T" is indicated by two stroke data IDs.

Further, the stroke array data shows detailed information as shown in FIG. FIG. 7 is a conceptual diagram showing stroke array data. As shown in FIG. 7, one stroke array data is represented by a plurality of stroke data. One stroke data includes a stroke data ID for identifying this stroke data, a start time indicating the time when writing one stroke starts, an end time indicating the time when writing one stroke ends, a color of the stroke, It shows coordinate array data ID for identifying the width of the stroke and the array of passing points of the stroke.

Furthermore, this coordinate array data shows detailed information as shown in FIG. FIG. 8 is a conceptual diagram showing coordinate array data. As shown in FIG. 8, the coordinate array data includes one point (X coordinate value, Y coordinate value) on the display 3, and the time (ms) of the difference from the stroke start time when passing this one point. ) and information on the writing pressure of the electronic pen 4 at this one point. That is, the collection of one point shown in FIG. 8 is shown by one coordinate array data shown in FIG. 7. For example, when a user draws the alphabet "S" with the electronic pen 4, it is written in one stroke, but since the user passes through multiple passing points before finishing drawing "S", the coordinate array data is information is shown.

Moreover, the media data of the page data shown in FIG. 6 shows detailed information as shown in FIG. FIG. 9 is a conceptual diagram showing media data. As shown in FIG. 9, the media data includes the media data ID in the page data shown in FIG. The data indicating the recording time, the position (X coordinate value, Y coordinate value) and size (width, height) of the image displayed on the display 3 according to the page data, and the content of the media data are displayed in association with each other. has been done. Among these, the position of the image displayed on the display 3 according to the page data is displayed according to the page data when the coordinates of the upper left corner of the display 3 are (X coordinate value, Y coordinate value) = (0, 0). This indicates the position of the upper left corner of the image.

Returning to FIG. 5, the remote license management table 310 manages license data necessary to execute remote sharing processing. In this remote license management table 310, the product ID of the display device 2, the license ID used for authentication, and the expiration date of the license are managed in association with each other.

<About account server functions>
FIG. 11 is an example of a functional block diagram illustrating functions of the account server 8 divided into blocks. The account server 8 includes a transmitting/receiving section 81, a user authentication section 82, and a record reading section 89. Each of these units included in the account server 8 is a function or means realized by the CPU 501 that executes a program loaded from the HD 504 onto the RAM 503. Further, the account server 8 has a storage unit 3000 configured by a RAM 503 and an HD 504.

The transmitting/receiving unit 81 receives account information from the display device 2 via the communication network 9, and transmits the authentication result, user authority (user ID, general user or administrator, etc.) to the display device 2.

The user authentication unit 82 queries the authentication information DB 3001 based on the account information to authenticate the user. If the account information is stored in the authentication information DB 3001, it is determined that the authentication is successful; if the account information is not stored, it is determined that the authentication has failed, and an authentication result is generated. The record reading unit 89 reads information from the storage unit 3000 and writes information to the storage unit 3000.

FIG. 12 schematically shows information stored in the authentication information DB 3001. Authentication information DB 3001 stores account information of each user. In FIG. 12, card information, user ID, password, and user name are stored in association with each other as account information. The card information is identification information of the IC card carried by the user, the user ID is identification information that identifies the user, the password is information known only to the user, and the user name is used to represent the user. Therefore, according to the account information shown in FIG. 12, the user can log in not only with a user ID and password, but also with a user name and password, or an IC card.

Note that the display device 2 may have an internal user authentication function.

<Function of display device 2 regarding tutorial display control>
Furthermore, the display device 2 has a function related to displaying a tutorial as shown in FIG. FIG. 13 is an example of a functional block diagram illustrating the functions of the display device 2 related to tutorial display control divided into blocks.

The display device 2 includes a display control section 71, a user authentication request section 72, and a provision control section 73. These functions possessed by the display device 2 are functions or means realized by the CPU 101 that executes a program loaded onto the RAM 103 from the SSD 104. The display device 2 also includes a function usage history DB 75 and a teaching material data DB 74, which are configured by a RAM 513 and an SSD 104.

The user authentication request unit 72 receives account information from the user, transmits the account information to the account server 8, and requests user authentication. The user authentication request unit 72 obtains the authentication result from the account server 8. If the authentication is successful, the login time 76 is recorded in the RAM 503, for example. Note that the account information may be input from soft keys displayed on the display 3 or from an IC card reader. If the authentication is successful, the display device 2 acquires the user ID, user authority, etc. from the account server 8. Upon successful authentication, the user logs into the display device 2 and can use the display device 2 according to the user's authority. In the case of authentication failure, the user cannot use the display device 2.

The display control unit 71 displays on the display 3 the tutorial that the provision control unit 73 has decided to provide. Although the display control section 71 is assumed to be a function of the UI image generation section 33, it may be a function independent of the UI image generation section 33.

The provision control unit 73 updates the function usage history table according to the usage status of the display device 2 by the user. Further, the tutorial to be provided is determined based on the information in the function usage history table, and the data of the tutorial is read from the teaching material data DB 74.

FIG. 14 shows an example of a function usage history table stored in the function usage history DB 75. The feature usage history table is a table that records for each user which feature the user used and when (the feature was used), and when the feature tutorial was provided (the feature usage instructions were provided). be. The function usage history table is associated with a user ID. Additionally, the number of logins for each user is recorded. Furthermore, whether the administrator or user has set to provide a tutorial (ON or OFF) is registered. The administrator makes a default setting (initial setting) regarding whether or not to provide a tutorial, and the user makes the setting individually.

As shown in FIG. 14, the function usage history table has the following items: function information, priority, user usage time, tutorial provision time, and function usage rate.

The function information is identification information of a function that the display device 2 has (a function that has a tutorial that can be used by the user). In other words, it is a function in which the display device 2 can provide a tutorial to show the user how to use it.

The priority is information representing the degree to which the tutorial is referenced to determine the functional information to be provided. The smaller the number, the higher the priority. An administrator or the like sets in advance a higher priority for basic functions. The basic function is a function necessary to provide the function of an electronic whiteboard, a function generally recognized as a function of an electronic whiteboard, or a function frequently used by users. The administrator can individually set the priorities from the PC or by operating the display device 2. Alternatively, the display device 2 may be downloaded from a predetermined server in a state where the function information and the priority are associated with each other.

The user use time is the date and time when the user last used the function information and the number of past uses (of course, it is from login to logout). The user usage time is used by the provision control unit 73 to calculate the function usage rate. The tutorial execution time is the date and time when the tutorial for the function was provided to the user (of course, it is from login to logout). The tutorial execution time only needs to be able to record whether or not the tutorial was provided in the past (that it was provided), and the date and time does not need to be included. Furthermore, if the user uses the service once or more during one login, the number of uses is counted as one (even if the user uses the service twice or more during login, it is counted as one use).

The function usage rate is the usage rate for each function. For example, the provision control unit 73 updates the number of uses of the function information at the user usage time after the user's login time, and calculates the function usage rate for each function from this and the number of logins. A feature usage rate does not exist for all features. For example, the calculation formula is as follows.
Latest usage count =
・If the user usage time after the login time is recorded, the past usage count + 1
- If the user use time after the login time is not recorded, the number of past uses Function usage history = Latest number of uses/Number of logins FIG. 15 shows an example of the teaching material data stored in the teaching material data DB 74. The teaching material data holds tutorial contents in association with functional information. The function information is the same as the function usage history table. The tutorial content is data for providing tutorials for each function. In the tutorial content, for example, the display positions of commands, messages, and images (frame lines in FIG. 15) executed by the display device 2 are registered.

For example, in the "Write" function, the display device 2 displays the same screen as when the user presses the "Write icon" (command execution), and displays "You can change the line color" and " It is registered to display a message that says "You can change the line thickness" or an image that emphasizes the button to be operated. Therefore, the display device 2 can provide a tutorial by executing commands and displaying messages and images at predetermined positions.

Alternatively, the tutorial content may be prepared as a PDF file. In this case, the display device 2 may display the PDF file.

In addition, the content of the tutorial may be indicated by a URL. For example, a URL may lead the user to a video site that plays a tutorial. Further, the tutorial content may be in any data format, such as text, images, graphics, audio, etc.

<Tutorial provision settings>
Since some users may not need a tutorial, each user can decide for himself whether or not to receive a tutorial. This can prevent the user from feeling bothered.

FIG. 16 shows an example of the tutorial provision setting screen 320. The provision setting screen 320 is displayed when the logged-in user presses an icon for making various settings. Or it will appear automatically when you first log in. Whether this is the first login or not is determined from the fact that there is no function information table for this user.

The provision setting screen 320 has a radio button 321, a cancel button 322, and an OK button 323 respectively associated with "use" and "do not use." The user selects the radio button 321 and presses the OK button 323. The press result is registered as ON or OFF in "Tutorial" of the function usage history table.

In FIG. 16, each user sets the tutorial function to be ON (enabled) or OFF (disabled), but the default setting (initial setting) is made in advance by the administrator. When the user turns the tutorial function ON or OFF, the user's setting takes priority over the default setting.

<Operation and processing>
Next, the overall process flow in which the display device 2 provides a tutorial will be described using FIG. 17. FIG. 17 is an example of a sequence diagram illustrating the procedure from login to update of function usage rate.

S1: First, the user logs into the display device 2. That is, the account information is input into the display device 2.

S1.1: User authentication request unit 72 receives account information and transmits it to account server 8. The user authentication section 82 of the account server 8 performs user authentication, and the transmission/reception section 81 transmits the authentication result to the display device 2. Here, the authentication is successful and the user ID is sent to the display device 2.

S1.2: The communication control unit 60 of the display device 2 receives the authentication result (authentication success, user ID), and the provision control unit 73 of the display device 2 selects the function associated with this user ID from the function usage history DB 75. Get usage history table.

S1.3: Steps S1.3 and S1.4 are performed when there is a function that the user has never used and for which no tutorial has been provided. Therefore, the provision control unit 73 extracts a function for which there is no record of user usage time and no record of tutorial execution time in the function usage history table. Then, provide tutorials for the features with the highest priority. If there are multiple functions with the same priority, they are executed in alphabetical order, such as by function name. Although only one tutorial is provided at a time, the provision control unit 73 may provide a plurality of tutorials in succession. Further, for example, if the user requests the next tutorial, the tutorial may be provided in response to the request. Therefore, the provision control unit 73 may prepare a plurality of tutorials in descending order of priority.

S1.4: When a tutorial is provided, the provision control unit 73 records the tutorial execution time in the function usage history table.

S2: It is assumed that the user uses the function according to the tutorial. In FIG. 17, writing was performed. You may use features that are not provided in the tutorial.

S2.1: The provision control unit 73 identifies the function used according to the element of the UI that is determined to be a UI operation by the event distribution unit 25 and the event has occurred. That is, the event distribution unit 25 identifies the UI operation to a certain icon based on the coordinates touched by the electronic pen 4. Since the operation processing unit 26 specifies the function of the operated icon, the provision control unit 73 records the user usage time of the function notified from the operation processing unit 26 in the function usage history table. Instead of recording at the timing when the function of the display device 2 is used, it may be recorded at the time of logout.

S3: User inputs logout operation. For example, press the logout button.

S3.1: When the user logs out, the provision control unit 73 identifies the functions whose user usage time in the function usage history table is later than the login time. Functions whose user use time is later than the login time are functions used during login, and functions whose user use time is earlier than the login time are functions that are not used during login. The provision control unit 73 calculates the function usage rate for each function based on "function usage history=latest number of uses/number of logins".

S3.2: The provision control unit 73 updates the function usage rate in the function usage history table with the calculated function usage rate. This allows the function usage rate to be updated for each function.

Next, the tutorial providing process will be explained using FIG. 18. FIG. 18 is an example of a flowchart illustrating the process by which the display device 2 provides a tutorial. The process in FIG. 18 is executed after the display device 2 is started.

The user authentication requesting unit 72 of the display device 2 confirms the setting of whether or not to perform authentication (S11). This is because depending on the display device 2, the administrator can set whether or not to use the authentication function. If the setting is not to authenticate, the user cannot be identified, so the process in FIG. 18 ends.

If the setting is to authenticate, the user authentication request unit 72 receives account information from the user (S12). If the user does not input account information, the process in FIG. 18 ends because the user cannot be identified.

When the user inputs account information, the user authentication request unit 72 obtains the authentication result (authentication success, authentication failure) from the account server 8 (S13). If the authentication is successful, the user authentication requesting unit 72 acquires at least the user ID. If the authentication fails, the process in FIG. 18 ends.

Next, the provision control unit 73 determines whether a function usage history table associated with the user ID exists in the function usage history DB 75 (S14).

Since the user who logs in to the display device 2 for the first time does not have a function usage history table, the provision control unit 73 creates a function usage history table (S15).

Next, the provision control unit 73 determines whether the tutorial function is valid or not by referring to the function usage history table (S16). If the tutorial function is not valid (OFF), the display device 2 does not provide a tutorial, and the process in FIG. 18 ends. When logging in for the first time, whether the tutorial function is enabled or disabled depends on the administrator's settings (default).

When the tutorial function is enabled (ON), the provision control unit 73 indicates that the user has never used it (there is no record of user usage time), and the tutorial is not provided (there is no record of tutorial provision time). It is determined whether the function is available (S17). If the determination in step S17 is No, no tutorial will be provided, and the process in FIG. 18 ends.

Here, it is limited to functions that are unused and for which a tutorial is not provided, but a tutorial may be provided for functions that are used less frequently than a predetermined frequency by the user. For example, a tutorial for a function that has been used twice or less may be provided, or a tutorial for which the function usage rate is less than a threshold value may be provided.

Furthermore, even if the user has used a function or a tutorial has been provided, a tutorial may be provided for a function for which a certain period of time has passed since the time the user used it, or for a certain period of time from the time the tutorial was provided. You may also provide tutorials for features that have passed. Tutorials can be provided for features that users do not use often or for features that have been available for some time. When providing a function for which a certain period of time has passed since the user's usage time or the tutorial provision time, it is preferable to provide the tutorial in descending order of function usage rate.

If the determination in step S17 is Yes, the provision control unit 73 provides the tutorial according to the priority of the function (S18). Functions with the same priority are determined in a fixed order, such as alphabetically by function name.

Note that when a new function is added due to a software version update, the administrator adds this function to each user's function usage history table and gives it maximum priority. Generally, the highest priority is set to 0, which is higher than the highest priority, such as 0. By doing so, the provision control unit 73 can provide a tutorial for the new function at the first login after the version upgrade.

<Supplementary information on priorities>
Although it has been described that functions that are used less than a predetermined frequency by a user are provided in descending order of priority, this priority may be adjusted based on the function usage rate of other users. For example, functions that a user has never used and for which a tutorial is not provided are sorted in descending order of function usage rate by other users.

FIG. 19 is an example of a flowchart for determining the order in which tutorials are provided for functions that the user has never used and for which no tutorials are provided. This process is executed in step S18 of FIG.

The provision control unit 73 obtains the function usage rate of other users (preferably all users) from the function usage history table for a function that the user has never used and for which a tutorial is not provided (S21). .

Next, the provision control unit 73 averages the function usage rates of other users for each function (S22). The provision control unit 73 sorts the functions in descending order of function usage rate by other users (S23).

If the provision control unit 73 provides tutorials in descending order of function usage rate by other users, tutorials for frequently used functions can be provided with priority. The user can also use functions that are convenient for other users.

<Providing two or more tutorials>
Some functions are often used consecutively. For example, a user may capture a screen and then send it via email. In this case, providing tutorials for the two functions in succession will increase the learning effect. Therefore, it is preferable that the provision control unit 73 refer to the user usage times of other users, extract a plurality of functions that are being executed continuously, and provide a tutorial for the plurality of functions.

FIG. 20 is an example of a flowchart showing a procedure in which the provision control unit 73 determines the functions for which tutorials are to be continuously provided. The process in FIG. 20 is executed in step S18 in FIG.

First, the provision control unit 73 determines the function A that provides the tutorial (S31). The determination method may use priority or the method shown in FIG. 19.

Next, the provision control unit 73 extracts function B (an example of a second function) that is executed consecutively with this function A (an example of a first function) from the function usage history table of other users (S32 ). For example, function A is searched from the function usage history table of each user, and function B' (candidate for function B) closest to the time when function A was used by the user is identified. Among the time differences between the user usage times of function A and function B' for each user, function B' with the smallest time difference is defined as function B that is executed consecutively with function A. Note that it is assumed that the time difference is within a threshold value that can be considered as continuous operation, and if it is not within the threshold value, it may be determined that function B is not present.

The provision control unit 73 provides a tutorial on function B following the tutorial on function A (S33).

By doing so, it is possible to provide consecutive tutorials for two functions that are likely to be used in succession, thereby increasing the learning effect.

<Tutorial display example>
FIG. 21 shows an example of a tutorial displayed on the display 3 of the display device 2. First, the initial state of the menu screen 330 is a state in which an icon list 331 of each function is displayed. The icon list 331 includes an icon 331a related to connection with another display device 2, an icon 331b for writing, an icon 331c for deleting a stroke, an icon 331d for moving back one operation, an icon 331e for advancing one operation, and an icon 331e for enlarging the screen. An enlarged icon 331f is displayed.

In FIG. 21, a tutorial regarding the write function is provided. Therefore, various buttons related to settings that can be selected from the write icon 331b are displayed. For example, a color button 332, a thickness button 333, a grid button 334, etc. are displayed. Additionally, a frame 342 surrounding various buttons and messages 341 such as ``You can change the color of the line'' and ``You can change the thickness of the line'' are displayed. The frame line 342 and message 341 allow the user to learn what the writing function is. That is, the frame line 342 and the message 341 are the tutorial.

The provision control unit 73 acquires the tutorial content of the function "Write" from the educational material data DB 74 while the initial menu screen 330 including the icon list 331 is displayed, and executes the command "Press the icon to write". In response, the state in which the writing icon 331b is pressed is reproduced, and two messages 341 and a frame line 342 are displayed at predetermined positions. This allows us to provide tutorials for each feature.

Note that the tutorial may be provided in audio form. In this case, an audio file is registered in the teaching material data, and the provision control unit 73 reproduces the audio file.

<Providing shortcuts for frequently used functions>
By utilizing the fact that the function usage rate is registered in the function usage history table, the display control unit 71 can also display an icon that calls a function with a high usage rate. An operation that calls a function with fewer operations than usual is called a shortcut. Hereinafter, the icon that can be used as a shortcut will be referred to as the function call icon 331g.

FIG. 22 is an example of an icon list 331 that includes icons that call functions with a high function usage rate. The function call icon 331g is associated with the top N functions with the highest function usage rates (N=3 in FIG. 22), and when the user presses the function call icon 331g, explanations 336a to 336c of the N functions are displayed. Is displayed. When one of the explanations 336a to 336c is pressed, the same process as when the icon of that function is pressed is performed. Therefore, the user can easily access (call) the functions that the user often uses from one place (function call icon 331g).

Such a function call icon 331g is convenient when the user uses a function that has a deep hierarchy but is often used.

FIG. 23 is an example of a flowchart showing a procedure in which the display control unit 71 displays the function call icon 331g. The process in FIG. 23 is executed when the display device 2 displays the icon list 331.

For example, a user logs in to the display device 2 (S41). In order to display the icon list 331, the display control unit 71 identifies the top N functions with the highest function usage rates in this user's function usage history table (S42).

The display control unit 71 displays N functions in association with the function call icon 331g (S43). Associating means setting the function description 336 and a link to the function in the function call icon 331g. The display control unit 71 displays a function description 336 when the function call icon 331g is pressed, and when the function description 336 is pressed, the operation processing unit 26 executes the linked function.

In this way, by using the function usage rate, users can easily access frequently used functions from one place.

<Summary>
As described above, according to the display device 2 of this embodiment, the user can try using a function that has not been used before by pressing an icon according to the tutorial. Since users have just logged in, they can use the same icons in meetings, making it easier to remember the functions. In this way, the display device 2 of this embodiment can reduce the number of functions that the user does not use.

In this embodiment, a display device that displays images by projecting them will be described.

<<Another example 1 of the configuration of the display device>>
Although the display device of this embodiment is described as having a large touch panel, the display device is not limited to having a touch panel.

FIG. 24 is a diagram showing another example of the configuration of the display device. In FIG. 24, a projector 411 is installed on the upper side of a normal whiteboard 413. This projector 411 corresponds to a display device. The normal whiteboard 413 is not a flat panel display integrated with a touch panel, but a whiteboard on which the user writes directly with a marker. Note that the whiteboard may be a blackboard, as long as it is a flat surface large enough to project an image.

The projector 411 has an ultra-short focus optical system and can project an image with little distortion onto the whiteboard 413 from a distance of about 10 cm. This video may be transmitted from the PC 400-1 connected wirelessly or by wire, or may be stored in the projector 411.

The user writes by hand on the whiteboard 413 using a dedicated electronic pen 2501. The electronic pen 2501 has, for example, a light emitting part at its tip that is turned on and emits light when the user presses it against the whiteboard 413 for handwriting. The wavelength of the light is near-infrared or infrared, so it is invisible to the user's eyes. The projector 411 has a camera that captures an image of the light emitting unit, analyzes the image, and identifies the direction of the electronic pen 2501. Further, the electronic pen 2501 emits sound waves along with light emission, and the projector 411 calculates the distance based on the arrival time of the sound waves. The position of the electronic pen 2501 can be specified based on the direction and distance. A stroke is drawn (projected) at the position of the electronic pen 2501.

Since the projector 411 projects the menu 430, when the user presses a button with the electronic pen 2501, the projector 411 identifies the pressed button based on the position of the electronic pen 2501 and the ON signal of the switch. For example, when the save button 431 is pressed, the stroke (set of coordinates) handwritten by the user is saved by the projector 411. The projector 411 stores handwritten information in a predetermined server 412, USB memory 2600, or the like. Handwritten information is saved for each page. Since the coordinates are saved as they are, not the image data, the user can re-edit them. However, in this embodiment, the menu 430 does not need to be displayed because operation commands can be called by hand.

<<Another example 2 of the configuration of the display device>>
FIG. 25 is a diagram showing another example of the configuration of the display device. The example in FIG. 25 includes a terminal device 600, an image projection device 700A, and a pen motion detection device 810 as display devices.

The terminal device 600 is connected to the image projection device 700A and the pen motion detection device 810 by wire. The image projection device 700A projects image data input by the terminal device 600 onto the screen 800.

The pen motion detection device 810 communicates with the electronic pen 820 and detects the motion of the electronic pen 820 in the vicinity of the screen 800. Specifically, the electronic pen 820 detects coordinate information indicating the point indicated by the electronic pen 820 on the screen 800 and transmits it to the terminal device 600.

The terminal device 600 generates image data of a stroke image input by the electronic pen 820 based on the coordinate information received from the pen motion detection device 810, and causes the image projection device 700A to draw the stroke image on the screen 800.

Further, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the stroke image input by the electronic pen 820.

<<Another example 3 of the configuration of the display device>>
FIG. 26 is a diagram illustrating a configuration example of a display device. The example in FIG. 26 includes a terminal device 600, a display 800A, and a pen motion detection device 810 as display devices.

Pen motion detection device 810 is placed near display 800A, detects coordinate information indicating the point indicated by electronic pen 820A on display 800A, and transmits it to terminal device 600. Note that in the example of FIG. 26, the electronic pen 820A may be charged by the terminal device 600 via the USB connector.

The terminal device 600 generates image data of a stroke image input by the electronic pen 820A based on the coordinate information received from the pen motion detection device 810, and displays it on the display 800A.

<<Another example 4 of configuration of display device>>
FIG. 27 is a diagram showing a configuration example of a display device. The example in FIG. 27 includes a terminal device 600 and an image projection device 700A as display devices.

The terminal device 600 performs wireless communication (such as Bluetooth (registered trademark)) with the electronic pen 820B and receives coordinate information of the point indicated by the electronic pen 820B on the screen 800. Then, the terminal device 600 generates image data of a stroke image input by the electronic pen 820B based on the received coordinate information, and causes the image projection device 700A to project the stroke image.

Further, the terminal device 600 generates superimposed image data indicating a superimposed image obtained by combining the background image projected by the image projection device 700A and the stroke image input by the electronic pen 820.

As described above, each of the embodiments described above can be applied in various system configurations.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using examples, the present invention is not limited to these examples in any way, and various modifications can be made without departing from the gist of the present invention. and substitutions can be added.

For example, in this embodiment, a display device that can be used as an electronic whiteboard has been described, but the display device only needs to be able to display an image, and may be, for example, a digital signage.

Further, the image 11 to be displayed may be a moving image or a still image.

Further, in this embodiment, an electronic whiteboard has been described as an example of a display device, but any information processing device having a touch panel can be suitably applied. Information processing devices equipped with touch panels include, for example, projectors (PJs), output devices such as digital signage, HUD (head up display) devices, industrial machinery, imaging devices, sound collection devices, medical equipment, network appliances, It may be a notebook PC (Personal Computer), a mobile phone, a smartphone, a tablet terminal, a game console, a PDA (Personal Digital Assistant), a digital camera, a wearable PC, a desktop PC, or the like.

Further, in this embodiment, the coordinates of the pen tip are detected by a method of detecting the coordinates of the pen tip using a touch panel, but the coordinates of the pen tip may also be detected by ultrasonic waves. The pen emits light and emits ultrasonic waves, and the display device 2 calculates the distance based on the arrival time of the ultrasonic waves. The location of the pen can be determined by direction and distance. The projector draws (projects) the trajectory of the pen as a stroke.

In addition, the configuration examples shown in FIGS. 5 and 13 are divided according to main functions in order to facilitate understanding of the processing by the display device 2. The present invention is not limited by the method of dividing the processing units or the names thereof. The processing of the display device 2 can also be divided into more processing units depending on the processing content. Furthermore, one processing unit can be divided to include more processing.

Moreover, each function of the embodiment described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (digital signal processors), FPGAs (field programmable gate arrays), and conventional circuit modules.

1 Image processing system 2 Display device 3 Display

Japanese Patent Application Publication No. 2014-230034

Claims (11)

A display device that identifies a user through external or internal authentication,
a provision control unit that provides a usage method for a function that is used less than or equal to a predetermined frequency by the user, based on function usage history information recorded for each function as to whether or not the user used the function;
The provision control unit records in the function usage history information for each function the fact that the function has been used and the fact that the usage method of the function has been provided;
A display device that provides a method for using a function that the user has never used and for which a method for using the function is not provided. A display device that identifies a user through external or internal authentication,
a provision control unit that provides a usage method for a function that is used less than or equal to a predetermined frequency by the user, based on function usage history information recorded for each function as to whether or not the user used the function;
The provision control unit registers the usage time when the user used the function in the function usage history information for each function,
The provision control unit may perform a second function that is executed consecutively with a first function that provides a method of using the function, and a second function that is executed sequentially with the first function and the second function in the function usage history information of other users. is determined based on the time difference between the usage times of the function candidates;
A display device that continuously provides a method for using the first function and a method for using the second function . Priority is set for each function in the function usage history information,
2. The display device according to claim 1 , wherein when there are a plurality of functions that are used less frequently than a predetermined frequency by the user, the provision control unit provides methods for using the functions in descending order of priority. The provision control unit registers a function usage rate of the functions used by the user in the function usage history information for each function,
If there are a plurality of functions that are used less frequently than a predetermined frequency by a user, the provision control unit provides methods for using the functions in descending order of the function usage rate of other users for the plurality of functions . The display device according to item 1 . The provision control unit registers the usage time when the user used the function in the function usage history information for each function,
The provision control unit may perform a second function that is executed consecutively with a first function that provides a method of using the function, and a second function that is executed sequentially with the first function and the second function in the function usage history information of other users. is determined based on the time difference between the usage times of the function candidates;
5. The display device according to claim 3, wherein a method for using the first function and a method for using the second function are provided consecutively. The provision control unit calculates the function usage rate by dividing the number of times a function is used by the number of logins of a function having a usage time when the user used the function after the user's login time. The display device according to item 4 . 7. The display device according to claim 1, wherein the provision control unit provides instructions on how to use the function immediately after the user logs in. determining the top N functions with the highest function usage rates based on the function usage history information;
a display control unit that sets explanations of N functions and links to the functions in predetermined icons, and displays the icons;
5. When the icon is pressed, descriptions of N functions are displayed, and when the description is pressed, the function corresponding to the pressed description is executed. Display device. A usage method provided by a display device that identifies a user through external or internal authentication, the method comprising:
Provides a method for using a function whose frequency of use by the user is less than a predetermined value, based on function usage history information recorded for each function as to whether or not the user used the function;
Recording in the function usage history information for each function the fact that the function was used and the fact that the usage method of the function was provided,
A method for providing a usage method, comprising providing a method for using a function that the user has never used and for which a method for using the function is not provided. Display devices that identify users through external or internal authentication,
Functioning as a provision control unit that provides a usage method for a function that is used less than or equal to a predetermined frequency by the user, based on function usage history information recorded for each function as to whether or not the user used the function;
The provision control unit records in the function usage history information for each function the fact that the function has been used and the fact that the usage method of the function has been provided;
A program for providing a method for using a function that the user has never used and for which a method for using the function is not provided. An image processing system comprising a server that authenticates a user, and a display device that acquires an authentication result from the server,
The server is
transmitting an authentication result based on the account information received from the display device and user identification information to the display device;
The display device includes:
a provision control unit that provides a usage method for a function that is used less than or equal to a predetermined frequency by the user, based on function usage history information recorded for each function as to whether or not the user used the function;
The provision control unit records in the function usage history information for each function the fact that the function has been used and the fact that the usage method of the function has been provided;
An image processing system that provides a method for using a function that the user has never used and for which a method for using the function is not provided.

Images