JP2020149633A - Display device, display method, and display program - Google Patents

Abstract

To improve operability for an object.SOLUTION: A display device comprises: an approach detection unit that detects approach of input means to a display unit on which an object is displayed; and a display control unit that, when the approach of the input means is detected, and a predetermined area including an image for selecting the object in the display unit includes a position indicated by the coordinates corresponding to the input means, enlarges and displays the image for selecting the object.SELECTED DRAWING: Figure 8

Description

The present invention relates to a display device, a display method, and a display program.

In recent years, drawing applications used in input devices using touch panel displays have become widespread. In the drawing application, characters and figures input by handwriting are drawn.

In a technique such as this drawing application, as one of the operations on an object displayed on a touch panel display, an operation of selecting an image at the corner of the object and dragging it to select and enlarge or reduce the object is known. ing.

In a drawing application, an image for selecting an object is generally provided small so as not to interfere with the drawing of the object. For this reason, in a conventional drawing application, when performing an operation for selecting an object, the image for selecting the object is hidden by the user's finger or an electronic pen for input, and an attempt is made to select the object by mistake. In some cases, an area other than the object was selected. The object may be, for example, characters, numbers, figures, symbols, or the like, or may be an illustration, a pattern, or the like.

The disclosed technology aims to improve the operability of objects.

The disclosed technology includes an approach detection unit that detects the approach of an input means to a display unit on which an object is displayed, and a predetermined area that includes an image for detecting the approach of the input means and selecting the object on the display unit. The display device includes a display control unit that enlarges and displays an image for selecting the object when the position indicated by the coordinates corresponding to the input means is included in the display device.

Improves operability for objects.

It is a figure explaining the electronic blackboard. It is a figure which shows an example of the hardware composition of an electronic blackboard. It is a figure explaining the functional structure of an electronic blackboard. It is a figure explaining the image displayed on the display of an electronic blackboard. It is a figure explaining an object. It is a figure which shows an example of the object storage part. It is a flowchart explaining operation of an electronic blackboard. It is the first figure explaining the display example of an electronic blackboard. It is the 2nd figure explaining the display example of an electronic blackboard. It is a figure explaining an image for selecting an object. It is a figure which shows an example of the system structure of the information processing system including an electronic blackboard. It is the first figure which shows the modification of an information processing system. It is a second figure which shows the modification of an information processing system. It is a third figure which shows the modification of an information processing system.

The present embodiment will be described below with reference to the drawings. FIG. 1 is a diagram illustrating an electronic blackboard.

The electronic blackboard 200 of the present embodiment includes a short-range communication circuit 219, a power switch 222, a display 280, and a camera 260. When the power switch 222 is pressed, the electronic blackboard 200 is a display unit in which a display control unit, which will be described later, displays a drawing screen on the display 280, which can be drawn by an electronic pen or a user's finger.

Further, the electronic blackboard 200 of the present embodiment detects that the user's finger or the electronic pen has approached the display 280 by the camera 260. That is, the camera 260 is an example of a proximity sensor. Further, when the camera 260 detects that the user's finger or the electronic pen approaches the image for selecting the object displayed on the display 280, the electronic blackboard 200 enlarges the image for selecting the object. To display.

The object of the present embodiment is an object of operation, and includes, for example, characters, numbers, figures, symbols, illustrations, patterns, and the like.

With this configuration, the electronic blackboard 200 of the present embodiment can suppress the occurrence of erroneous operations due to the image for selecting an object being hidden by the user's finger or the electronic pen, and can improve the operability of the object. ..

The hardware configuration of the electronic blackboard 200 of the present embodiment will be described below with reference to FIG. FIG. 2 is a diagram showing an example of the hardware configuration of the electronic blackboard.
FIG. 2 is a hardware configuration diagram of the electronic blackboard. As shown in FIG. 2, the electronic blackboard 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an SSD (Solid State Drive) 204, and a network I / It includes an F205 and an external device connection I / F (Interface) 206.

Of these, the CPU 201 controls the operation of the entire electronic blackboard 2. The ROM 202 stores a program used to drive the CPU 201 such as the CPU 201 and the IPL (Initial Program Loader). The RAM 203 is used as a work area of the CPU 201. The SSD 204 stores various data such as a program for an electronic blackboard.

The network I / F 205 controls communication with the communication network. The external device connection I / F 206 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory 230 and an external device (microphone 240, speaker 250, camera 260).

Further, the electronic blackboard 200 includes a capture device 211, a GPU 212, a display controller 213, a contact sensor 214, a sensor controller 215, an electronic pen controller 216, a short-range communication circuit 219, an antenna 219a of the short-range communication circuit 219, a power switch 222, and the like. It includes selection switches 223.

Of these, the capture device 211 causes the display of the external PC (Personal Computer) 270 to display the video information as a still image or a moving image. The GPU (Graphics Processing Unit) 212 is a semiconductor chip that specializes in graphics.
The GPU 212 may be built in the CPU 201 or may be integrated with the CPU 201.

The display controller 213 controls and manages the screen display in order to output the output image from the GPU 212 to the display 280 or the like. The contact sensor 214 detects that the electronic pen 290, the user's hand H, or the like has come into contact with the display 280. The sensor controller 215 controls the processing of the contact sensor 214.

The contact sensor 214 inputs and detects the coordinates by the infrared blocking method. In this method of inputting coordinates and detecting coordinates, two light receiving and emitting devices installed at both upper ends of the display 280 emit a plurality of infrared rays in parallel with the display 280 and are provided around the display 280. This is a method of receiving light that is reflected by a reflecting member and returns on the same optical path as the light path emitted by the light receiving element. The contact sensor 214 outputs an infrared ID emitted by two light emitting / receiving devices blocked by the object to the sensor controller 215, and the sensor controller 215 specifies a coordinate position which is a contact position of the object.

The electronic pen controller 216 determines whether or not there is a touch of the pen tip or a touch of the pen tail on the display 280 by communicating with the electronic pen 290. The short-range communication circuit 219 is a communication circuit such as NF (Near Field Communication) or Bluetooth (registered trademark). The power switch 222 is a switch for switching the power ON / OFF of the electronic blackboard 2. The selection switches 223 are, for example, a group of switches for adjusting the brightness and hue of the display of the display 280.

Further, the electronic blackboard 2 includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201 shown in FIG.

The contact sensor 214 is not limited to the infrared blocking method, but is a capacitive touch panel that specifies a contact position by detecting a change in capacitance, and a contact position is specified by a voltage change between two opposing resistance films. Various detection means such as a resistance film type touch panel and an electromagnetic induction type touch panel that detects the electromagnetic induction generated when a contact object comes into contact with the display unit and specifies the contact position may be used. Further, the electronic pen controller 216 may determine whether or not there is a touch not only on the pen tip and pen tip of the electronic pen 290 but also on the portion gripped by the user of the electronic pen 290 and other electronic pen portions.

Further, in the present embodiment, the camera 260 is an example of a proximity sensor that detects that the electronic pen 290 or the hand H is approaching the display 280, but the electronic blackboard 200 is a projection type capacitance type as a proximity sensor. It may have a touch panel, an infrared sensor, or the like.

Next, the functional configuration of the electronic blackboard 200 of the present embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a functional configuration of the electronic blackboard.

The electronic blackboard 200 of the present embodiment includes a page storage unit 320, an object storage unit 330, an input unit 341, a page generation unit 342, an object identification unit 343, a coordinate acquisition unit 344, an approach detection unit 345, an area determination unit 346, and display control. It has a unit 347 and an object update unit 348.

The page storage unit 320 stores page data displayed on the display 280 of the electronic blackboard 200. The page data stored in the page storage unit 320 may be, for example, stroke image data indicating a stroke image drawn on the display 280, or image data acquired from the outside.

The stroke image is an image of a locus of each stroke input by hand using an electronic pen 290 on the display 280 of the electronic blackboard 200.

Further, the page data may be image data of a superimposed image in which the image displayed on the display 280 and the stroke image input to the display 280 are superimposed. Details of the image data displayed on the display 280 will be described later.

The object storage unit 330 stores object information related to the object. Specifically, the object storage unit 330 stores an image of a predetermined rectangular region including a stroke drawn by handwriting or an electronic pen 290 on the display 280 as an object among the image data. That is, the object is an image of a rectangular area including a stroke image. Further, the object storage unit 330 holds coordinate information indicating the positions of four points when the object, which is a rectangular area, is displayed on the display 280. The details of the object storage unit 330 will be described later.

The input unit 341 acquires stroke images showing characters and images handwritten to the display 280, image data of images displayed on the touch panel provided on the display 280, and the like.

In addition, the input unit 341 acquires moving image data or the like taken by the camera 260. In the present embodiment, the moving image data is included in the image data. Further, the input unit 341 receives various instructions for the electronic blackboard 200. Further, the input unit 341 acquires input image data or the like output from the PC 270 or the like and input to the electronic blackboard 200.

The page generation unit 342 acquires the image data of the image (display image) of one page displayed on the display 280. Further, when the stroke image is input to the image of one page, the page generation unit 342 acquires the stroke image data indicating the stroke image.

Specifically, the page generation unit 342 acquires image data of a superimposed image in which an input image, a stroke image, or the like input to the display 280 is superimposed, and stores the image data in the page storage unit 320. When the stroke image is not input to the display 280, the page generation unit 342 uses the image displayed on the display 280 as the image data.

Further, when the stroke image is input to the display 280, the page generation unit 342 stores the stroke image data indicating the stroke image as image data in the page storage unit 320.

As described above, the page generation unit 342 of the present embodiment is a generation unit that generates page data from the image data displayed on the display 280 and the stroke image data indicating the stroke image input to the display 280.

The object identification unit 343 identifies an image in a rectangular area including a stroke image input by handwriting or an electronic pen 290 as an object.

The coordinate acquisition unit 344 acquires the coordinates of four points in the rectangular area specified by the object identification unit 343, and stores the coordinates in the object storage unit 330 in association with the object.

Further, the coordinate acquisition unit 344 acquires information indicating a predetermined area including a corner of a rectangular area that identifies the object, and stores the information in the object storage unit 330 in association with the object. In the following description, a predetermined area including the corners of the rectangular area that specifies the object is referred to as a corner area. That is, the corner region of the present embodiment is a predetermined region on the display 280 that includes an image for selecting an object displayed on the display 280 and is associated with an image for selecting an object.

Further, in the following description, associating a rectangular area including an object with information for specifying a corner area may be expressed as setting a corner area. Details of the rectangular area and the corner area including the object will be described later.

The approach detection unit 345 detects that the object has approached the display 280. Specifically, the approach detection unit 345 detects that the electronic pen 290 or the handwritten image input means such as the user's hand has entered the display 280 within a predetermined distance. In the following description, an object for inputting a handwritten image, such as an electronic pen 290 or a user's hand, may be expressed as an input means.

The area determination unit 346 determines whether or not an object that can be an input means for a handwritten image is close to a predetermined area including a corner of a rectangular area that identifies the object displayed on the display 280.

Specifically, the area determination unit 346 determines whether or not the coordinate information corresponding to the input means detected by the approach detection unit 345 is in the corner area.

The display control unit 347 controls various displays on the display 280. When the area determination unit 346 determines that the coordinate information corresponding to the input means is within the corner area, the image showing the corner is enlarged and displayed. Further, the display control unit 347 is enlarged and displayed when the area determination unit 346 determines that the coordinate information corresponding to the input means is outside the corner area in the state where the image showing the corner is enlarged and displayed. Restores the image showing the corners to the original size.

When the display control unit 347 performs an operation of enlarging or reducing the object, the object update unit 348 updates the object information stored in the object storage unit 330 in response to the operation.

Next, the image displayed on the display 280 will be described with reference to FIG. FIG. 4 is a diagram illustrating an image displayed on a display of an electronic blackboard.

FIG. 4A is a diagram for explaining the superimposed image, and FIG. 4B is a diagram showing an example of the superimposed image.

In the electronic blackboard 200 of the present embodiment, the display control unit 347 superimposes and displays an input image, a stroke image, a UI (User Interface) image, and a background image acquired by the input unit 341 according to a layout specified in advance. Let me.

The UI image is a preset image. The background image is, for example, a plain image, an image including grid lines, or the like, and is media data included in the superimposed image. The media data is data for displaying a background image on the display 280.

As shown in FIG. 4, the display control unit 347 displays a layer 41 for displaying a UI image, a layer 42 for displaying a stroke image, and an input image output from a PC and input to the electronic whiteboard 200. It has a layer 43 and a layer 44 for displaying a background image.

When the display 280 is viewed from the user of the electronic blackboard 200, the display control unit 347 of the present embodiment has layer 41 as the first layer, layer 42 as the second layer, layer 43 as the third layer, and layer 44 as the fourth layer. Each layer is superimposed so as to be.

Then, the display control unit 347 synthesizes the image data of the UI image (UI image data), the stroke image data, the image data of the input image (input image data), and the image data of the background image (background image data). The image data of the four-layer superimposed image 40 is generated.

That is, the superimposed image of the present embodiment is an image obtained by synthesizing the images displayed on each layer of the display 280.

In the description of the present embodiment, the stroke image displayed on the layer 42 is specified as an object, but the image specified as an object may be an image other than the stroke image.

Next, the object of this embodiment will be described with reference to FIG. FIG. 5 is a diagram illustrating an object. FIG. 5A is a diagram for explaining an object and a rectangular area for specifying an object, and FIG. 5B is a diagram for explaining a corner area of the rectangular area.

In FIG. 5A, the stroke image 51 is surrounded by a rectangular area 52. In the present embodiment, in the image displayed on the display 280, the rectangular area 52 including the stroke image 51 is specified as an object.

The image included in the rectangular area specified as an object may be an image other than the stroke image. In other words, the image included in the rectangular region specified as the object may be an image displayed on a layer other than the layer 42 of the stroke image described with reference to FIG.

At the four corners of the rectangular area 52, angle images 53 to 56 showing the corners of the rectangular area 52 are displayed. Normally, when the user tries to enlarge the stroke image, any one of the corner images 53 to 56 is selected and dragged by the electronic pen 290 or a finger. That is, the corner image of the present embodiment is associated with an object and is an image for selecting an object.

In the present embodiment, corner regions 61 to 64 centered on the corners are set around each of the corner images 53 to 56 showing the corners of the rectangular region 52.

In the present embodiment, when it is detected that the electronic pen 290 or the finger approaches the corner images 53 to 56 displayed on the display 280 and enters any of the corner regions 61 to 64, FIG. As shown in B), the angular images 53 to 56 are enlarged to make the angular images 53A to 56A.

In the present embodiment, by enlarging the corner image in this way, it is easy for the user to select the corner image showing the corner of the object.

Next, the object storage unit 330 of the present embodiment will be described with reference to FIG. FIG. 6 is a diagram showing an example of an object storage unit.

Object information about an object is stored in the object storage unit 330. The object information includes an object ID, a stroke ID, angular coordinates, an angular region, image data, and the like as information items. The value of the item "object ID" is the identification information for identifying the object, and the value of the item "stroke ID" is the identification information for specifying the stroke image.

The value of the item "angle coordinates" indicates the coordinates of the corners of the rectangular area which is an object. The value of the item "corner area" is information for specifying the corner area. Specifically, the value of the item "corner region" indicates the length in the vertical direction and the horizontal direction in which the corner region is determined to be a rectangular region of a predetermined size centered on each of the angular coordinates. ..

The value of the item "image data" is image data indicating a stroke image corresponding to the stroke ID.

In the present embodiment, when the stroke image is input by the input unit 341, the object identification unit 343 and the coordinate acquisition unit 344 acquire the values of each item included in the object information and use the object information.

Next, the operation of the electronic blackboard 200 of the present embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart illustrating the operation of the electronic blackboard.

In the electronic blackboard 200 of the present embodiment, when a stroke image is input by the input unit 341, the object identification unit 343 identifies a rectangular area including the stroke image, and the coordinate acquisition unit 344 indicates the corner of the rectangular area. The coordinates are acquired and stored in the object storage unit 330 (step S701).

Subsequently, the electronic blackboard 200 determines whether or not an object that can be an input means such as an electronic pen 290 or a user's finger has approached the display 280 within a predetermined distance by the approach detection unit 345 (step). S702).

In step S702, if not approaching, the electronic blackboard 200 stands by. When it is determined in step S702 that the electronic blackboard 200 has approached, the electronic blackboard 200 refers to the object storage unit 330, and the area determination unit 346 sets the coordinates indicating the position corresponding to the input means on the display 280 to the object storage unit 330. It is determined whether or not it is within any range of the stored angular regions (step S703).

If it is outside the corner region in step S703, the electronic blackboard 200 returns to step S702.

In step S703, when it is within the corner area, the display control unit 347 indicates the corner indicating the corner of the object displayed on the display 280 as the corner area including the coordinates indicating the position corresponding to the input means. The image is enlarged (step S704).

At this time, the display control unit 347 may enlarge the size of the corner image so that it becomes the same size as the corner region.

Next, the electronic blackboard 200 determines whether or not the coordinates indicating the position corresponding to the input means are no longer in the corner region by the region determination unit 346 (step S705). When the image is no longer in the corner area in step S705, the display control unit 347 returns the enlarged corner image to the initial state (step S706), and ends the process. In other words, the display control unit 347 returns the enlarged angle image to the size before the enlargement.

In step S705, when it is within the corner region, the electronic blackboard 200 determines whether or not the contact sensor 214 has detected that the input means has come into contact with the corner image by the input unit 341 (step S707). If the contact is not detected in step S707, the electronic blackboard 200 returns to step S705.

When the contact is detected in step S707, the electronic blackboard 200 causes the display control unit 347 to enlarge or reduce the object according to the operation (step S708).

Subsequently, the electronic blackboard 200 returns the enlarged corner image to the initial state by the display control unit 347, updates the object information of the enlarged or reduced object by the object update unit 348 (step S709), and ends the process. To do. Specifically, the object update unit 348 acquires the coordinates indicating the corners of the object after the operation, and updates the corner area so as to correspond to the acquired coordinates.

Next, the display transition of the display 280 of the electronic blackboard 200 will be described with reference to FIG. FIG. 8 is a first diagram illustrating a display example of the electronic blackboard.

FIG. 8 shows a display transition when the object 81 displayed on the display 280 is reduced.

In the electronic blackboard 200, the electronic pen 290, which is one of the input means, approaches within a predetermined distance in a state where the object 81 and the angle images 82 to 85 showing the corners of the object 81 are displayed on the display 280. Is detected. Further, the electronic blackboard 200 detects that the coordinates indicating the position corresponding to the electronic pen 290 on the display 280 are within the corner region corresponding to the corner indicated by the corner image 82 of the object 81.

Then, the electronic blackboard 200 displays the corner images 82 to 85 of the object 81 displayed on the display 280 as the corner images 82A to 85A enlarged so as to have the same size as the corner region. At this time, only the corner image in which the coordinates indicating the position corresponding to the electronic pen 290 are within the corner region may be enlarged and displayed. Therefore, in this case, only the corner image 82 may be enlarged.

Next, when the electronic blackboard 200 detects the contact of the electronic pen 290 with the enlarged square image 82A and accepts the operation of reducing the object 81 by the electronic pen 290, the object 81 becomes the reduced object 81A.

Then, the electronic blackboard 200 returns the enlarged corner images 82A to 85A to the corner images 82 to 85 in the initial state, updates the object information of the object 81 with the object information of the object 81A, and ends the process.

FIG. 9 is a second diagram illustrating a display example of the electronic blackboard. FIG. 9 shows a display transition in which the object 81 displayed on the display 280 is not operated.

In the example of FIG. 9, the electronic pen 290 approaches the display 280 of the electronic blackboard 200, and the coordinates indicating the position corresponding to the electronic pen 290 are within the corner region corresponding to the corner image 82 of the object 81. Images 82 to 85 become enlarged angular images 82A to 85A.

After that, the electronic pen 290 does not come into contact with the enlarged corner image 82A, and when the coordinates indicating the position corresponding to the electronic pen 290 are outside the corner region corresponding to the corner image 82, the enlarged corner image 82A to 85A returns to the angle images 82 to 85 in the initial state.

As described above, according to the present embodiment, when an operation for performing an operation on an object is detected, the image for selecting the object is enlarged. Therefore, according to the present embodiment, the image for selecting the object is displayed in a size that does not interfere with the input of the stroke image, the display of the image, etc., when the operation on the object is not performed. Since the image is enlarged according to the operation of the object, it is possible to improve the operability of the object while suppressing erroneous operation.

In the above-described embodiment, the image for selecting an object is described as a corner image showing the corners of a rectangular area showing an object, but the image for selecting an object is other than the image showing the corners of a rectangular area. It may be an image of.

FIG. 10 is a diagram illustrating an image for selecting an object. In the example of FIG. 10, an image showing a rectangular region 102 including a stroke image 101 is specified as an object 103.

Further, in the example of FIG. 10, in addition to the angular images 104 to 107, two images 108 and 109 are present on the long side of the rectangular region 102 as images for selecting the object 103.

In this case, if the electronic pen 290 approaches the region corresponding to the corner image including the image 109, the corner images 104 to 107 and the images 108 and 109 are enlarged to become the corner images 104A to 107A, 108A and 109A. ..

As described above, in the present embodiment, the image for selecting the object may be an image other than the corner image indicating the corner of the rectangular region indicating the object, and may be an image associated with the object. Further, in the figure described above, the shape of the image for selecting the object is a rectangle, but the shape of the image for selecting the object may be any shape. For example, the image for selecting an object may be a circle, an arrow, or a shape in the shape of a human hand. Further, the size of the image for selecting the object may be determined in relation to the size of the object.

Further, in the figure described above, the image for selecting the object is displayed on the outer circumference of the object, but the image is not limited to this. The image for selecting the object may be displayed at the position associated with the object. Therefore, for example, when the rectangular area showing the object is sufficiently small as compared with the display area of the display 280 and it is difficult to display an image for selecting the object on the outer circumference of the object. An image for selecting an object may be displayed at a position away from the outer circumference of the object.

Further, in the present embodiment, the shape indicating the object is a rectangle, but the present invention is not limited to this. The object may have a shape such as a circle or an ellipse including a stroke image or the like.

Further, the electronic blackboard 200 of the present embodiment may be included in a system that communicates with the server device.

FIG. 11 is a diagram showing an example of a system configuration of an information processing system including an electronic blackboard. The information processing system 500 includes an electronic blackboard (electronic information board) 200 and a server device 550. In the information processing system 500, the electronic blackboard 200 and the server device 550 are connected via a network.

In the information processing system 500 of the present embodiment, the electronic blackboard 200 uses image data (captured image data) that captures the screen of the electronic whiteboard 200, and stroke image data indicating characters, images, and the like handwritten to the electronic whiteboard 200. , Acquires voice data and the like collected by a sound collecting device such as a microphone, and transmits the sound data to the server device 550. The electronic blackboard 200 of the present embodiment may transmit the date and time when various data are acquired in association with the acquired information to the server device 550.

Further, the electronic blackboard 200 can communicate with a plurality of terminal devices, and image data and audio data may be acquired from each terminal device. In this case, the image displayed on the electronic blackboard 200 may be shared by a plurality of terminal devices, and the electronic blackboard 200 is a shared terminal for displaying a screen shared by the plurality of terminal devices.

Next, a modification of the above-mentioned information processing system will be described with reference to FIGS. 12 to 14.

FIG. 12 is a first diagram showing a modified example of the information processing system. In the example of FIG. 12, instead of the electronic blackboard 200, the terminal device 600, the image projection device 700, and the pen motion detection device 810 are provided.

The terminal device 600 is wiredly connected to the image projection device 700 and the pen motion detection device 810.

The image projection device 700 projects the image data input by the terminal device 600 onto the screen 800.

The pen motion detection device 810 communicates with the electronic pen 820 and detects the motion of the electronic pen 820 in the vicinity of the screen 800. Specifically, the electronic pen 820 detects coordinate information indicating a point indicated by the electronic pen 820 on the screen 800 and transmits the coordinate information to the terminal device 600.

The terminal device 600 generates stroke image data indicating a stroke image input by the electronic pen 820 based on the coordinate information received from the pen motion detection device 810, and causes the image projection device 700 to draw the stroke image on the screen 800.

Further, the terminal device 600 generates page data including superimposed image data indicating an image projected on the image projection device 700, and transmits the page data to the server device 550.

FIG. 13 is a second diagram showing a modified example of the information processing system. In the example of FIG. 13, instead of the electronic blackboard 200, the terminal device 600, the display 800A, and the pen motion detection device 810 are provided.

The pen motion detection device 810 is arranged in the vicinity of the display 800A, detects coordinate information indicating a point indicated by the electronic pen 820A on the display 800A, and transmits the coordinate information to the terminal device 600. In the example of FIG. 13, the electronic pen 820A may be charged by the terminal device 600 via the USB connector.

The terminal device 600 generates image data of a stroke image input by the electronic pen 820A based on the coordinate information received from the pen motion detection device 810, and displays the image data on the display 800A.

Further, the terminal device 600 of the present embodiment generates page data including superimposed image data indicating an image projected on the image projection device 700, and transmits the page data to the server device 550.

FIG. 14 is a third diagram showing a modified example of the information processing system. In the example of FIG. 14, instead of the electronic blackboard 200, the terminal device 600 and the image projection device 700 are provided.

The terminal device 600 performs wireless communication (Bluetooth or the like) with the electronic pen 820B, and receives the coordinate information of the point indicated by the electronic pen 820B on the screen 800. Then, the terminal device 600 generates image data of the stroke image input by the electronic pen 820B based on the received coordinate information, and the image projection device 700 projects the stroke image on the screen 800.

Further, the terminal device 600 generates page data including superimposed image data indicating an image projected on the image projection device 700, and transmits the page data to the server device 550.

As described above, each of the above-described embodiments can be applied in various system configurations.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

The device to which the present embodiment is applied may be a display device having a function of operating an object by a touch operation, and is not limited to the electronic blackboard 200. Devices to which this embodiment is applied include, for example, PJs (projectors), output devices such as digital signage, HUD (Head Up Display) devices, network home appliances, connected cars, notebook PCs (personal computers), and the like. It may be a mobile phone, a smartphone, a tablet terminal, a game machine, a PDA (Personal Digital Assistant), a wearable PC, or the like.

Further, the device group described in the embodiment is only one of a plurality of computing environments for implementing the embodiment disclosed in the present specification.

In certain embodiments, the first device comprises a plurality of computing devices, such as a server cluster. The plurality of computing devices are configured to communicate with each other over any type of communication link, including networks, shared memory, and the like, and perform the processes disclosed herein. Similarly, the second device can include multiple computing devices configured to communicate with each other.

Further, the first device and the second device can be configured to share the processing steps shown in FIG. 7 in various combinations. For example, a process performed by a given unit may be performed by a second device. Similarly, the function of a given unit can be performed by a second device. Further, each element of the first device and the second device may be integrated into one server device, or may be divided into a plurality of devices.

Although the present invention has been described above based on each embodiment, the present invention is not limited to the requirements shown in the above embodiments. With respect to these points, the gist of the present invention can be changed without impairing the gist of the present invention, and can be appropriately determined according to the application form thereof.

200 Electronic blackboard 320 Page storage 330 Object storage 341 Input unit 342 Page generation unit 343 Object identification unit 344 Coordinate acquisition unit 345 Approach detection unit 346 Area determination unit 347 Display control unit 348 Object update unit

Japanese Unexamined Patent Publication No. 2017-204082

Claims (8)

An approach detection unit that detects the approach of the input means to the display unit on which the object is displayed,
To select the object when the approach of the input means is detected and the position indicated by the coordinates corresponding to the input means is included in the predetermined area including the image for selecting the object on the display unit. A display device having a display control unit for enlarging and displaying an image of. The display device according to claim 1, wherein the image for selecting the object is an image displayed along the outer circumference of the object. The object is a rectangular area, and the image included in the object is a stroke image input by handwriting input by the input means.
The display device according to claim 2, wherein the image for selecting the object is an image including the corners of the rectangular region. The display control unit
The display device according to any one of claims 1 to 3, wherein an image for selecting the object is enlarged to the same size as the predetermined area. The display control unit
Claim 1 to return the image for selecting each enlarged object to the size before enlargement when the position indicated by the coordinates corresponding to the input means is a position outside the predetermined area. The display device according to any one of 4. The display device according to any one of claims 1 to 5, further comprising an area determination unit for determining whether or not a position indicated by coordinates corresponding to the input means is included in the predetermined area. A display method using a display device, wherein the display device
Detects the approach of the input means to the display where the object is displayed,
To select the object when the approach of the input means is detected and the position indicated by the coordinates corresponding to the input means is included in the predetermined area including the image for selecting the object in the display unit. A display method that enlarges and displays the image of. Detects the approach of the input means to the display where the object is displayed,
To select the object when the approach of the input means is detected and the position indicated by the coordinates corresponding to the input means is included in the predetermined area including the image for selecting the object on the display unit. A display program that causes a display device to execute processing that enlarges and displays the image of.

Images