JP2016148858A - System, projector device and portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To store written record backgrounds of all attendants in order to use backgrounds including the development progress of the written records later by preventing the inhibition of browsing a white board due to the position of an attendant who performs writing on a white board.SOLUTION: Terminals of all attendants include a terminal with a touch panel having a function for dividing an inputted arbitrary line drawing into line segments to transmit the line segments one by one to a controller and also displaying line drawing information transmitted from the controller on a display of the terminal with a touch panel, and also uses a liquid crystal projector which includes or can be connected with a controller having a function for additionally writing a white board image in a video image memory while recording the line drawing information transmitted from each terminal with a touch panel in a database one by one, projecting contents of the video image memory onto a wall surface by the liquid crystal projector, and transmitting the database to each terminal with a touch panel at the same time.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronically constructed graphic input / display device that can be freely written and modified by handwriting input simultaneously by a plurality of participants at a conference or a presentation.

  Usually, at meetings and presentations that are required to proceed while proposing new items, direct writing, correction, erasure, and change can be done by handwriting on a large screen like a blackboard, and all participants can It is desirable to have a screen that can be viewed simultaneously.

  In general, white boards that can be used for small-to-medium-sized meetings and the like can be written, corrected, and erased with a water-based pen on a white panel. This white board is also used which has a function of reading the final result of what has been entered by an image scanner, printing it on paper, and leaving a copy of the conference result.

Furthermore, as a method for storing and managing a copy of a conference result as electronic information, Patent Document 1 of the prior art document includes a terminal device including a plurality of handwriting input devices and information input by handwriting on each terminal device. An invention is described that gathers in a server, sets a handwriting input area of each terminal for each specific area in the display window of the server, and displays information input in each terminal.
Patent Document 2 describes a data format suitable for transmitting a handwritten line input by a telewriting device as a digital signal by a still image communication device.

JP 2008-269525 A JP-A-6-296210

  The problem to be solved by the present invention is to prevent browsing of the white board by filling in or editing the white board that can be viewed by all the participants all at once. In addition, we will provide a means for later reviewing the history of the completed records, including the progress of the recorded records, so that information such as discussions at the conference will be available for activities based on the progress of the effective conference and the results of the conference. It is to provide a means for enabling more useful utilization.

  Accordingly, an object of the present invention is to improve user convenience in a conference or the like using a projector and a terminal.

  The object of the present invention can be achieved by the configuration described in the claims as an example.

  ADVANTAGE OF THE INVENTION According to this invention, the convenience of the user in the meeting etc. using a projector and a terminal can be improved.

It is explanatory drawing which shows the connection between each apparatus which comprises a figure input / display apparatus and a portable terminal, and a specific operation | movement image. It is explanatory drawing explaining the handling and format of the data for inputting and displaying a some line segment simultaneously in a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the output of the data packet from each terminal, the data transmission to a projector, and the redistribution of the data packet from a projector to a terminal of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the display method at the time of inputting a line drawing into the terminal device with a touch panel in a figure input / display apparatus and a portable terminal. It is an example of the block diagram which shows the system structure of the portable terminal of a figure input / display apparatus. It is an example of the block diagram which shows the system structure of the intelligent liquid crystal projector of a figure input / display apparatus and a portable terminal. It is explanatory drawing explaining the 1st Example which shows the relationship between the structure of software, and hardware of a figure input / display apparatus. It is explanatory drawing explaining the 2nd Example which shows the structure of the software of a figure input / display apparatus and a portable terminal, and a hardware. It is explanatory drawing which showed UI which performs conversation only between specific terminals during a meeting using a figure input / display apparatus and the component apparatus of a portable terminal. It is explanatory drawing which showed the method of displaying by which user the line in which drawing is progressing is written by the figure input / display apparatus and the portable terminal. It is explanatory drawing which showed the flow of the drawing data handled with a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the operation | movement which operates the flow of the drawing data handled with a figure input / display apparatus and a portable terminal with the flowchart. It is explanatory drawing which showed the rewind reproduction | regeneration operation | movement of the white board image in the middle of the meeting progress of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the method of drawing and displaying collectively the line drawing of the fixed unit which a participant draws in a figure input / display apparatus and a portable terminal. It is explanatory drawing which shows the example of the display screen of a terminal of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the prohibition state of entry / deletion by the specific terminal of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the method of stopping operation of a terminal of a figure input / display apparatus and a portable terminal temporarily by an operator's intention. It is explanatory drawing which showed the screen when the operator of each terminal of a figure input / display apparatus and a portable terminal records a memo personally. It is explanatory drawing which showed the screen which cleans a standard figure automatically of a figure input / display apparatus and a portable terminal. It is explanatory drawing which shows the example of a screen in a character input of a figure input / display apparatus and a portable terminal. It is explanatory drawing which shows the example of a conference participant's ID display of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the example in the case of presetting the screen at the time of the meeting start of a figure input / display apparatus and a portable terminal. It is explanatory drawing which shows the structure in a terminal in the case of having conversation only between specific terminals during a meeting using a structural apparatus of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the operation | movement regarding an automatic scale change of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the participant confirmation operation using the camera of a figure input / display apparatus and a portable terminal. It is explanatory drawing which showed the specific operation | movement of the camera part of the participant confirmation using a camera of a figure input / display apparatus and a portable terminal.

Hereinafter, a specific embodiment of a graphic input / display apparatus according to the present invention will be described with reference to the drawings.
FIG. 1 is an explanatory diagram showing a connection between devices and a specific operation image constituting a graphic input / display device and a portable terminal according to the present invention.
An intelligent liquid crystal projector 10010 is a device that projects a white plate onto a wall surface or a screen. This is composed of a liquid crystal projector 10020 and a controller 10030. The liquid crystal projector 10020 and the controller 10030 can be built in the same housing or separately, and the projection image data from the controller 10030 can be analog or Any method of transmitting by a digital signal may be used. The transmitted projection image is projected on the wall surface (10011) and can be viewed by all the participants of the conference as a large screen image.
Participants in the conference each have their own touch panel and a terminal with a touch panel (10040-100070) integrated with the same size display, and can input and edit handwritten line drawings on the touch panel using pens (10041, 10042). .
In this embodiment, the controller in the intelligent liquid crystal projector 10010 and each terminal with a touch panel (10040 to 10070) are connected by a wireless LAN (Local Area Network). As this LAN environment, a wireless LAN environment shared and used in a general office may be used. However, in this embodiment, each touch panel connected with an IP address provided by the controller using the controller 10030 as a router. It is configured with a LAN where the connection environment is closed only between the attached terminals (10040 to 10070). The operation at the start of the conference consists of IP address distribution to multiple touch-panel-equipped terminals whose MAC addresses are already registered in the controller, and operation with a touch-panel terminal brought to the conference by the controller. A communication connection environment is constructed by inputting an ID code or the like projected by a liquid crystal projector from a switch or a controller to the terminal.
A specific operation will be described below. In this example, the lines input to the terminals with touch panels (10040 to 10070) with the pens (10041, 10042) are the terminal with the touch panel (10040) and the terminal with the touch panel (10070). It is a state that is being done. In other words, on the final whiteboard image, the two line drawings continue to grow at the same time, as if the two participants were physically writing on the conventional whiteboard at the same time. The
The same image as the projected white board image 10011 is simultaneously displayed on each of the terminals with touch panels (10040 to 10070), and the conference participant can add or modify the image while viewing the latest white board image.
In the image displayed on the terminal with projection and touch panel (10040 to 10070), an icon 10012 indicating the status of each terminal with touch panel (10040 to 10070) of the participant participating in the conference is superimposed and displayed. In this example, four terminals are participating, but in the conference system in this example, a maximum of six terminals can participate, among which the fourth and sixth terminals are absent or a terminal with a touch panel is in operation. It is not in the state. The devices with touch panels (10040 to 10070) of participants who are participating in the conference are here terminal ID # 1 (10040), terminal ID # 2 (10050), terminal ID # 3 (10060), terminal ID # 5 (10070), among which terminals with ID # 1 (10040) and ID # 2 (10050) are in the state of inputting line drawings at the same time.
FIG. 2 is an explanatory diagram for explaining the handling and format of data for simultaneously inputting and displaying a plurality of line segments in the figure input / display apparatus and portable terminal according to the present invention.

  As shown in FIG. 2 (a), the line drawing 20000 input to the terminal with touch panel by the pen 20001 is converted into an aggregate 20020 of line segments 20003 composed of a plurality of straight lines by the conversion process 20010 in the terminal. The

  Each line segment is handled as a start point Xstart (hereinafter referred to as Xs), Ystart (hereinafter referred to as Ys), Xend (hereinafter referred to as Xe), and Yend (hereinafter referred to as Ye).

  FIG. 2B shows a data format in which each line segment obtained by dividing the input line image is handled as a data packet 200040 for each line segment. Each data packet contains the terminal ID of the terminal that entered the line segment, the coordinates of the start point and end point, the line thickness, color, and type described later, and line type data according to various usage methods such as eraser and laser pointer. Consists of.

  These line segment data are input from each terminal according to the time axis 20055. In each terminal, the user can input as if he / she was writing with a stroke as a single line drawing (FIG. 2 (a) 20060). The controller 10030 receives the input from the terminal 1 (20060) and the input from the terminal 2 (20070) mixed for each line segment divided at a predetermined sampling time interval.

  The received packet 200040 is stored in the controller 10030 as a data list in the order of reception, and is output to a video memory (not shown) that constructs a white board image in time series in the order received from this, and each terminal with a touch panel (20080). ). The video memory that received the output writes each line segment data as image data in the self video memory in the order of the received packet data. Similarly, each received terminal constructs and outputs each line segment as image data in its own video memory.

  By this method, it is possible to perform a process of making a line drawing written simultaneously by a plurality of participants appear as if a plurality of lines are continuously extended on the screen.

  FIG. 3 is an explanatory diagram showing the output of data packets from each terminal, the transmission of data to the projector, and the redistribution of data packets from the projector to the terminals of the graphic input / display device and portable terminal according to the present invention. .

  A data packet indicating line segment data output from terminal # 1 (30001) is generated at each predetermined sampling timing, and is transmitted to the intelligent LCD projector controller 30003 in units of each line segment, such as 30010, 30011, and 30012. The A data packet indicating line segment data which is asynchronously synchronized with the transmission data and is stationary at a predetermined sampling timing is transmitted from the terminal # 2 to the controller 30003 as 30020 and 30021.

  The controller receives and stores it in the order of reception, displays it on the liquid crystal projector according to the order, and redistributes it to each terminal 30004. This distribution timing operates at a predetermined timing interval, and is transmitted at a speed according to the frame timing of the display device of the display unit of the projector or each terminal, for example.

  As a result, the projector image projected on the wall surface on the large screen and the lines that are simultaneously written in the terminal # 1 and terminal # 2 on the display unit of each participant's touch panel terminal device, and the lines that extend as they are filled, are the same. It is displayed on the screen so as to stretch at the same time, and it can be seen that the line drawings input from multiple terminals are displayed at the same time.

  FIG. 4 is an explanatory diagram showing a display method when a line drawing is input to a terminal device with a touch panel in the graphic input / display device and portable terminal of the present invention.

  As described with reference to FIG. 3, the line segment data input from the touch panel of each terminal is once transmitted to the controller, combined with the input from other terminals, and then retransmitted to each terminal and displayed. In this case, the input time of the line with the pen and the actual time displayed on the terminal are the same as the time required for the data to be reciprocated to the controller and the data synthesis by the controller until the actual display after the line was written on the touch panel A slight delay occurs between the display times of the lines to be displayed, and even if the lines are drawn, they are not displayed immediately and become difficult to use.

  In this embodiment, first, in FIG. 4A, the terminal device with a touch panel displays an immediate line based on the line drawing data input with the pen. With this terminal data display 40000, since there is no time difference as described above and the line drawing as drawn with the pen is immediately displayed, natural input can be performed as if the line drawing was directly written on the paper with a pencil.

  Next, the line segment data redistributed from the controller is displayed. The reception data display 40010 displays a line drawing so as to follow the line drawing that has already been written with the pen and follow the delay time difference. Basically, this line is the same line as when the line drawing was first drawn with a pen, but the line received with a line with different display formats such as color and thickness to distinguish it from the display on the terminal. Is displayed. The received data display 40010 displayed thereafter is a line drawing officially written on the white board.

  FIG. 5 is an example of a block diagram showing a system structure of a portable terminal of the figure input / display apparatus and portable terminal according to the present invention.

  In this embodiment, the mobile terminal uses the configuration of a general computer system, and various types of hardware are connected using a bus 50001 around the CPU 50000, and each hardware has a hardware interface (not shown). Then, control of data input, storage, output, etc. is performed according to control of a program operating on the CPU.

  The terminal uses the CPU as a core to display the LCD 50010 as a display device, V-RAM (Video-RAM) 50050 for constructing an image to be displayed on the display device, and detects the touch of a pen or finger as a coordinate value over the LCD Touch panel 50020, flash memory 50060 that stores programs executed by CPU 50000 and basic data, various switches 50030 for turning on / off the terminal and adjusting backlight, RAM 50070 used by CPU 50000 as a work area, for example, camera 50040, etc. Image data input devices other than the touch panel, and a wireless LAN 50080 for transmitting and receiving line segment data obtained by converting the input line image. Each device has an interface (not shown) as described above, and by connecting to the CPU bus 50001, input / output data to each device can be handled by a program operating on the CPU.

  FIG. 6 is an example of a block diagram showing a system structure of an intelligent liquid crystal projector of a graphic input / display device and a portable terminal according to the present invention.

  Also in this embodiment, the intelligent liquid crystal projector uses a general computer system configuration like the terminal shown in FIG. 5, and various types of hardware are connected using a bus 6601 around the CPU 60000. Each hardware incorporates a hardware interface (not shown), and controls data input, storage, and output in accordance with control of a program operating on the CPU.

  The intelligent LCD projector uses the CPU as the core, built-in or external projector 60010, V-RAM (Video-RAM) 60040 to construct an image to be sent to the projector for display, various switches for power ON / OFF and various operations 60020, flash memory 60050 that stores programs executed by CPU60000 and basic data, RAM60060 that CPU60000 uses as a work area, and a LAN with IP addresses assigned to terminals with touch panels, and lines sent from each terminal The wireless LAN router 6030 is configured to receive and retransmit minute packets. Each device has an interface (not shown) as described above, and by connecting to the CPU bus 6601, input / output data to each device can be handled by a program operating on the CPU.

  FIG. 7 is an explanatory diagram for explaining a first embodiment showing the relationship between the software structure and hardware of the graphic input / display device and portable terminal according to the present invention.

  FIG. 7A shows the configuration of the terminal device, which operates under the overall control of an operating system (hereinafter referred to as OS) 70010, and a white board application 70000 is executed under the management of the OS. The white board application and the OS are connected to each hardware by application interfaces (hereinafter referred to as APIs) 7001, 7002, 7003, and the white board application exchanges data with each hardware via the OS.

  Data constituting the handwritten line drawing input on the touch panel 70021 is input to the OS by the touch panel driver 70011 and input to the white board application via the API 7001. At this time, the sampling timing described with reference to FIG. 3 is performed at the timing of the coordinate acquisition instruction on the touch panel from the whiteboard application to the OS, and the coordinates when the pen or finger is touching, touching, or touching the touch panel. Is converted into packet data for each line segment described with reference to FIG. 2, and is displayed on the LCD via the API70003, OS70010, and LCD driver 70013 (70023). At the same time, the data is transmitted from the wireless LAN 70022 to the intelligent liquid crystal projector via the API70002, the OS 70010, and the wireless LAN driver 70012.

  FIG. 7B shows the configuration of the intelligent liquid crystal projector, particularly the configuration of the controller, which operates under the overall control of the OS 70050, and the white board application 70040 is executed under the management of the OS. The white board application and the OS are connected to each hardware by application interfaces (hereinafter referred to as API) 70041 and 70042, and the white board application transmits / receives data to / from each hardware via the OS.

  The line segment data constituting the input handwritten line drawing connected to each terminal by the wireless LAN router 80062 and transmitted from the connected terminal is input to the OS by the wireless LAN driver 70052, and the white board application is transmitted via the API 70042. Is input. This data is transmitted from a plurality of terminals, but it is converted into a data list in chronological order as they are received and stored in the whiteboard application. At the same time, the liquid crystal projector driver 70051 uses the liquid crystal projector driver 70051 via the API70041 and OS70050 And displayed as a projection screen 70061.

  At the same time, a set of line segment data received from a plurality of terminals is redistributed to each terminal by radio wave transmission from the wireless LAN router 70062 by the wireless LAN driver 70052 via the API 70042 and OS70050.

  It is converted into packet data for each line segment described in FIG. 2, and is displayed on the LCD via the API70003, OS 70010, and LCD driver 70013 (70023). At the same time, the data is transmitted from the wireless LAN 70022 to the intelligent liquid crystal projector via the API70002, the OS 70010, and the wireless LAN driver 70012.

  Here, the data packet stored in FIG. 7 (b) may be discarded when it is displayed on the liquid crystal projector and retransmitted to each terminal, but by storing all the data in the conference, , It is possible to leave a meeting record saved in time series on the white board of the meeting, and when a terminal that participated in the meeting in the middle occurred, by sending a data packet from the start of the meeting, Discussions prior to the time of participation can be confirmed with whiteboard information. This is because the proceedings from the start of the meeting can be reconfirmed at any time during the meeting by saving on each terminal as shown in FIG. It becomes possible.

  FIG. 8 is an explanatory diagram showing a second embodiment showing the relationship between the software structure and hardware of the graphic input / display device and portable terminal according to the present invention.

  FIG. 8 (a) shows the configuration of the intelligent liquid crystal projector of FIG. 7 (b), particularly the controller unit, and the structure thereof is the same as that of FIG. 7 (b), and detailed description thereof is omitted.

  This embodiment is characterized in that a web browser which is a general-purpose display program is used instead of the white board application 80000 as a program for processing a display image displayed on the liquid crystal projector.

  In the homepage description language called HTML5, in addition to the conventional graphic image display by image data, as shown in Fig. 8 (b), attributes such as the start point and end point of the line segment, color, width, etc. are set. There is a function to display line segments. Using this, the line segment data output from the whiteboard application is converted to the HTML5 description language, and then input to the browser 80030 via the API80002, OS80010, API80031. The browser 80030 is the API80031, OS80010, LCD A white board image 80023 is projected through the projector driver 80013.

  Although not shown in FIG. 8, the terminal device is the same, and a general-purpose browser can be used by incorporating a browser and an API in FIG. 7 (a), and is not particularly dependent on the hardware specifications of the output device. It becomes possible to provide equipment.

  FIG. 9 is an explanatory diagram showing a UI for carrying out a conversation only between specific terminals during a conference using the graphic input / display device and the mobile terminal component device according to the present invention.

  Although the operation of the hardware and communication application is not shown, when an IP address is distributed by a wireless LAN router and a terminal having an individual IP address makes a conversation with a conversation request from terminal 1 to terminal 5, for example, the IP address Either a direct communication between each other or a communication route via a white board application may be used.

  In this embodiment, an example of UI of two terminals is shown. Here, a case where a call is made from the terminal 1 to the terminal 5 is shown.

  As described with reference to FIG. 1, ID names 9902 of terminals participating in the same conference are arranged in the shape of icons at the upper part of the terminal screen (90000). In addition to the number, the difference between the terminals is also distinguished by the color of the icon, and the terminals that are not participating or are not turned on are displayed with a cross marked with a cross. The terminal displays the border around the icon with a thick line.

  9A, when the terminal 1 on the left side wants to contact the user of the terminal 5, the pen 90001 is used to touch the icon of the terminal 5. Since the screen 90010 of the terminal 5 on the right side has not received a call yet, the same screen as the projected white board is displayed as described with reference to FIG. 1 (90010).

  When a call from the terminal 1 to the terminal 5 is started in FIG. 9B, a window 90020 indicating that the call is in progress is displayed on the screen of the terminal 1. Then, on the screen of the terminal 5, a window 90021 for displaying that it has been called from the terminal 1 is displayed. At the same time, the terminal 5 icon flashes on the terminal 1 screen, and the terminal 1 icon flashes on the terminal 5 screen to display to the user the occurrence of the call.

  Here, when the terminal 5 responds to a call from the terminal 1, for example, the icon of the blinking terminal 1 may be touched. When the call is to be canceled, the call window 90021 from the terminal 1 is touched. Also good. If the terminal 1 wants to interrupt the call in the middle, the window 90020 may be touched, and although it is not shown, it indicates that it responds to the call that is separately displayed in the window or the corner of the screen during the call. An icon, an icon for rejecting the call, or an icon for interrupting the call by the calling party may be displayed and touched.

  FIG. 9C shows a screen in which the terminal 5 starts contact in response to a call from the terminal 1. Both terminals display windows 90030 and 90031 labeled CHAT-1 and CHAT-5, respectively. As for this window, the call display window in FIG. This window becomes an input screen having the same function as the white board that is displayed only between the terminal 1 and the terminal 5, and the two terminals communicate with each other by inputting characters by handwriting into this window. I can do it. The data transmission / reception method at this time can be realized by the same method as the method of transmitting / receiving the line drawing inputted by the graphic input / display apparatus shown in FIGS.

  The windows 90030 and 90031 are displayed here so as to cover the white board of the entire conference. Therefore, the white board cannot be viewed during communication between the two terminals. In this case, for example, by dragging the part marked “CHAT- # 5” or “CHAT- # 1” at the top of the windows displayed on both terminals with a pen or finger, It is also possible to refer to the white board of the entire conference on the back, and although not shown in the figure, the window is translucent and covers the entire touch panel, so that it can be added to the white board of the entire conference. It is also possible to perform communication only between two terminals. These operations can be executed by the white board application shown in FIG.

  FIG. 10 is an explanatory view showing a method of displaying which user is writing a line in which drawing is in progress in the figure input / display apparatus and portable terminal according to the present invention.

  FIG. 10 (a) shows the display screen 100000 of the terminal # 1, which is in the middle of drawing a drawn line on the left side of the screen with the pen 100001.

  FIG. 10B shows a screen projected by the figure input / display device and a screen displayed on another terminal. The screen on the left is being drawn by the terminal # 1, and the screen on the right is the terminal #. This is a screen after a predetermined time has elapsed since the drawing of 1 was completed.

  The line in the middle of drawing is drawn in a color indicating the terminal # 1, specifically, a color displaying the icon of the terminal # 1. When the drawn line is completed, the color of the line is the color specified by the terminal # 1 in advance. If you are using it, the color of the line drawn in black will change. At this point, the drawing of terminal # 1 has been completed and will be handled as a screen for discussion during the proceedings of the meeting.

  Here, if two or more terminals, such as terminal # 1 and terminal # 2, are drawing at the same time, the color of the line being drawn is an icon indicating the terminal ID being drawn in the left figure. When the predetermined time has elapsed after the drawing is finished, the color changes to the color set by each terminal to indicate that the drawing is completed.

  FIG. 10C is an example showing a method different from FIG. 10B in which drawing display is performed when a plurality of terminals perform drawing at the same time. The drawn line on the left side of the screen is drawn by the terminal # 1, and the drawn line on the right side of the screen is being drawn by the terminal # 2.

  At this time, balloon messages 100030 and 100040 indicating that terminal # 1 is drawing are displayed at the end points of each drawn line, that is, the end points where the line extends according to the drawing of each terminal as time passes, and the end points are moved. As the message moves, the position of the message also moves. Then, when a predetermined time has elapsed after completion of drawing, the color changes in the same manner as in FIG. 10B, and is handled as a screen for discussion during the proceedings of the meeting.

  FIG. 11 is an explanatory diagram showing the flow of drawing data handled by the graphic input / display device and portable terminal of the present invention.

  In the explanation of this figure, the flow of data is explained. Therefore, the destination of data movement is a drawing in which software and hardware are mixed.

  First, the handwritten drawing input to the touch panel 110032 is input to the application 110000 via the touch panel driver 110030. Here, the drawing data is divided into the line segments described with reference to FIG. 2, and is transmitted from the wireless LAN 110041 to the intelligent liquid crystal projector controller via the wireless LAN driver 110040.

  The controller receives the line segment packet data transmitted by the wireless LAN 110051, enters the application 110010 via the wireless LAN driver 110050, and is stored together in the line segment data packet 110001. As shown in FIG. 2B, the stored line segment data packet is stored in a state in which line segment packet data input from a plurality of terminals are mixed.

  The saved line segment packet data is called in the order of saving (110005), is input to the projector 110061 through the projector driver 110060, and is projected as a large screen white board image 110062. At the same time, it is redistributed to each terminal via the wireless LAN driver 110050 and the wireless LAN 110051 (110004), and is collectively stored in the segment packet data 110001 in the terminal via the wireless LAN 110041 and the wireless LAN driver 110040 of each terminal. . Then, like the controller, the data is called in the order of input and displayed on the LCD 110020 of the terminal through the display driver 110010.

  Here, as shown in FIG. 4A, when the redrawn data is drawn after the handwritten input drawing data is once transmitted to the controller, there is a time difference between the handwriting timing and the display timing. In order to prevent a sense of incongruity in the drawing operation, as indicated by a dotted line 110002, data input on the touch panel 110032 is displayed on the LCD 110020 simultaneously with being transmitted to the controller. After that, by displaying the returned data, as shown in FIG. 4B, it is possible to display that the redistributed drawing data is drawn so as to follow the growth of the real-time drawing line. I can do it.

  FIG. 12 is an explanatory diagram showing, in a flowchart, an operation for manipulating the flow of drawing data handled by the graphic input / display apparatus and portable terminal of the present invention.

  FIG. 12A shows a part for inputting and transmitting drawing data in a terminal with a touch panel, and corresponds to 110003 in FIG. That is, the drawing received on the touch panel is received as a line segment (120000), and is transmitted for each line segment (120001).

  FIG. 12B is a portion for inputting and transmitting drawing data in the terminal with the touch panel. This is a case where drawing data is once displayed in the terminal as shown in FIG. 4A, and includes 110002 in FIG. That is, the drawing received on the touch panel is received as a line segment (120010), displayed on the terminal LCD (120011), and transmitted for each line segment (120012).

  FIG. 12 (c) shows the operation of the terminal that accepts the line segment data retransmitted from the projector, and corresponds to the operation centered on the storage and readout of the line segment packet data 110001 in FIG. . The terminal first receives line segment data (120020), stores it in line segment packet data (120021), reads the data (120022), and displays the read line segment data on the LCD (120023).

  FIG. 12D shows an example of the reception operation of the projector, which corresponds to an operation centered on storing and reading out the line segment packet data 110011 in FIG. The projector receives the line segment data transmitted from each terminal (120030), and stacks and stores it in the line segment packet data each time one packet is received (120031).

  FIG. 12 (e) shows data retransmission by the projector, and corresponds to 1100004 in FIG. The line segment data stacked and stored in the line segment packet data is mixed with line segment data from a plurality of terminals at this time, but is read in the order of writing (120040), and from each terminal Re-distributed to each terminal is read data in which the data is mixed.

  FIG. 13 is an explanatory diagram showing a rewinding reproduction operation of a white board image during the progress of a conference by the figure input / display apparatus and the portable terminal according to the present invention.

  The line segment data packet described in FIG. 7B is recorded from the beginning of the conference as described in FIG. 11 and FIG. The progress can be reconfirmed, and the participant who has participated from the beginning can also play back the recording from the beginning of the conference. In this embodiment, a UI for performing the operation will be described.

  FIG. 13A shows a screen of each terminal with a touch panel in FIG. Here, a rewind instruction (130010) button is provided and displayed at the lower left of the screen. When the rewind instruction button is touched during the meeting, the screen changes as shown in FIG. Here, at the bottom of the screen, a bar 130020 indicating a time axis with the horizontal axis from the start of the conference to the present is displayed, and a pointer 130040 is displayed thereon. By designating this pointer with a pen and dragging it to the left or right, the displayed screen can be changed to a screen at a point in time from the latest one to a predetermined time. The retroactive time is displayed as 130050, and here, the screen 12 minutes before the latest point is displayed.

  These operations can be executed by the white board application shown in FIG.

  FIG. 14 is a diagram input / display apparatus and portable terminal according to the present invention, in which a line drawn by a participant is not displayed even during drawing in real time, and all line drawings in a certain unit are drawn and then displayed together. It is explanatory drawing which showed the method.

  FIG. 14A shows a display screen 140000 of a certain terminal. Here, a drawn line 140011 on the right side indicates that the participant is inputting a line drawing with the pen 140011 using this terminal. Here, the operation mode of this terminal is switched to the SUBMIT mode by a method described later in FIG. 15. In this state, the line drawn by the terminal is not transmitted while being divided into immediate line segments. The terminal does not transmit until the operator completes the drawing and transmits them all at once.

  FIG. 14B shows a projection screen 140030 of the projector when the participant is drawing in FIG. As described above, since drawing data is not transmitted from the terminal, nothing is displayed on the projector.

  FIG. 14C shows a screen after the operator completes a series of drawing in FIG. 14A and touches the “SUBMIT” button with a pen or a finger in hope of display. This screen is the same for projectors and other terminals, and the line drawings at a fixed end inputted in FIG. 14A are drawn together (140040) and displayed. In order to indicate that the user of the terminal # 2 has input at that time, here, as shown in FIG. 10C, a balloon message 140041 indicating that the terminal # 2 has drawn for a predetermined time after the batch drawing is displayed. In the same manner as in the above-described embodiment, after the display for a predetermined time, the balloon message disappears and is displayed as a line of a preset color.

  FIG. 15 is an explanatory view showing an example of a display screen of the terminal of the figure input / display apparatus and portable terminal according to the present invention.

  Although it was omitted in the drawings so far, it is a terminal device with a touch panel that performs handwritten drawing, and a menu screen 150010 for designating the type of handwritten line etc. can be selected on the screen 150000, in this embodiment on the left side it's shown.

  The components of the displayed menu are a selection menu of an eraser and laser pointer mode in addition to a line type (straight line and two types of dotted lines). Here, in addition to the type of line to be drawn, it is also possible to erase the drawing already described by replacing the pen with an eraser. At this time, erasure by the eraser is also saved as movement data of the line segment, so that the description before erasure can be saved, and the past description can be reconfirmed at the time of playback shown in FIG. The laser pointer mode is characterized in that the same operation can be performed on the screen of the terminal with the touch panel at hand in addition to direct laser pointer irradiation to the projector projection image.

  The following components are described with three examples of line thickness and line color. Next, by selecting the SUBMIT mode with the switch button between the “DRAW” mode and the “SUBMIT” mode, it is possible to switch to the mode for performing batch drawing as shown in FIG.

  The last is “ENABLE”, which means that if another terminal, especially a host terminal, is set, or if the projector controller is configured separately from the liquid crystal projector as a single touch panel-equipped terminal, It can act as a host, and it can control permission / prohibition of white board entry / deletion of a specific terminal by an instruction from there, and displays the status.

  FIG. 16 is an explanatory diagram showing a state of prohibiting entry / deletion by a specific terminal of the graphic input / display apparatus and portable terminal according to the present invention.

  FIG. 16 (a) shows a screen of a terminal that is prohibited from entry / deletion on the white board in FIG. 15, and the character “ENABLE” shown in FIG. 16 is “DISABLE” (160030). ). At the same time, the “DRAW” and “SUBMIT” buttons indicating the input mode are also masked to indicate that the terminal cannot be input.

  FIG. 16 (b) shows the projector display 160050 when the terminal # 2 is in the entry / deletion prohibited state in FIG. 16 (a), and the same is displayed on the other terminals. The

  The icon of terminal # 2 is painted darker than the specified color, so that other participants and the projector display can recognize that terminal # 2 is not ready for participation. .

  FIG. 17 is an explanatory diagram showing a method of temporarily stopping the operation of the terminal of the graphic input / display device and the portable terminal according to the present invention by the operator's intention.

  FIG. 17A shows an item operated by the operator in the menu screen 170010 on the terminal screen 170000 of the operator who sits during the conference. When the operator selects “OFFLINE”, control is performed so that the entry / deletion operation on this terminal becomes impossible and the white board image displayed on the screen cannot be seen. As a result, when the operator leaves the seat, for example, when the terminal is left as it is, the operator takes out the terminal so that other participants cannot perform operations such as entry or deletion. For example, when placed in his or her seat, even if communication is connected by wireless LAN, it is possible to prevent the white board from being viewed, entered and deleted by anyone other than the conference participants.

  FIG. 17B is a screen of the terminal after “OFFLINE” is pressed in order to sit down during the conference. In the present embodiment, in order to achieve the function of individually locking each center seat, a leave instruction screen 170020 is displayed to prompt the participant to input an electronic signature used when returning from the center seat. . By entering the electronic signature and pressing “ENTER” at the lower right of the leave instruction screen, the terminal screen becomes a center-seat screen, with the same layout as the leave instruction screen in a position to hide all white board drawings The resumption instruction screen is displayed. The input electronic signature detects the feature point, saves the data, and is used for collation with the electronic signature input by the restart instruction shown in FIG.

  FIG. 17C is a diagram showing the input of an electronic signature to the restart instruction screen 170040. Here, a case where a different electronic signature is inserted is shown. Even if the electronic signature is input and “ENTER” is pressed, since the electronic signature is different from FIG. 17B, the terminal displays “INVALID!” And does not allow resumption. When the electronic signature is correctly entered, the resume instruction screen disappears and the screen before leaving the seat where the white board is displayed is returned.

  FIG. 18 is an explanatory diagram showing a screen when the operator of each terminal of the figure input / display apparatus and portable terminal according to the present invention records a memo personally.

  In FIG. 18A, in this embodiment, a “MEMO” button is provided in a part of the menu screen 180000, and pressing this button switches to the “MEMO” mode.

  FIG. 18B is an entry screen for the terminal in the “MEMO” mode, and the line drawing described in 180030 is a memo only for the operator of the terminal. This memo is not displayed on the projector screen 180040 shown in FIG. 18C or on other terminals.

  Although not shown, the format of this memo data is the same as that of the line segment packet data shown in FIG. 2 and later, and is written in particular at which time (when displaying which packet) of the line segment packet data stored separately. Link information indicating the relationship in the time axis direction is added to the packet data and held. When displaying the memo, it is possible to superimpose the playback as shown in FIG. 13, and the white board image referred to by all members of the conference and the memo are displayed not only on the current screen but also in the past. It is also possible to play back the display on the screen.

  FIG. 19 is an explanatory diagram showing a screen for automatically clearing a standard graphic of the graphic input / display device and portable terminal according to the present invention.

  On the terminal screen 190,000, use standard drawing lines such as enclosing points that should be noted during drawing during a meeting with circles or highlighting with double underline in the case of characters. There is a case.

  These are not particularly meaningful for subtle differences in the shape of the drawing lines. Conversely, a figure that is written correctly is an effective type of drawing. In the present embodiment, as shown in the handwritten line drawing 190010, a circle described so as to emphasize a part of a figure is automatically recognized as a sign to emphasize instead of a figure, and an accurate ellipse is obtained as a clear result 190020. By rewriting it, it becomes possible to keep the layout collapse due to handwriting on the white board. This copy is also displayed on the projector as shown in FIG.

  Although not shown, the data packet to be saved may be saved as packet data including a center point coordinate location and a diameter value that represents a standard figure in addition to the method of saving after dividing into line segments. Good.

  FIG. 20 is an explanatory view showing a screen example in character input of the graphic input / display device and portable terminal according to the present invention.

  In a conference using a white board, all entries are basically made by handwriting. However, in the case of character input, line drawing is handled as digital information, so that it is possible to prevent the interpretation failure due to the quality of the author's characters.

  FIG. 20 (a) shows a terminal screen 200000 in which characters are first input by handwriting. Since characters are input in the handwritten line drawing 200010, the writer's personality is obtained, but the characters are often not easy to read. Here, as shown in Fig. 19 (b), input characters are converted into character codes by using the line drawing / character conversion function attached to OCR (Optiocal Character Reader) automatically or by selection / conversion by the writer. The character string corresponding to the character code is printed and displayed (20020). As a result, difficult-to-read character input is sometimes automatically converted to improve the conference environment using a white board.

  Although not shown, the input character is not a line drawing but a character code, as described in FIG. 19 (c), in the data packet to be saved in the format of the character string start point coordinates, character size, and character code string. Save it.

  FIG. 20 (c) shows a method of clearing by direct character input using a software keyboard without using handwriting input from the beginning when inputting characters. For example, especially when a general-purpose portable terminal is used for this conference, the software keyboard 200030 that is installed as a standard feature can be used to configure the program so that it can be incorporated into the whiteboard application via the OS through a dedicated API. Display of the characters (200040) can be easily realized. The method for saving the input character data may be the same as that described in FIG.

  FIG. 21 is an explanatory view showing an example of ID display of a conference participant in the figure input / display device and portable terminal according to the present invention.

  In the drawings described above, the conference participants displayed by the projector and the terminal are indicated by the terminal ID number. If this is used at the start of the meeting or each person brings and uses his / her own portable terminal, the name of the participant can be directly displayed as the personal name icon 210010 instead of the terminal ID. This can be realized by inputting the name by the method shown in FIG. 20 at the start of the conference.

  FIG. 22 is an explanatory diagram showing an example of presetting the screen at the start of the conference of the graphic input / display device and portable terminal according to the present invention.

  Even in a conventional conference using a white board, the organizer often holds a meeting after the title, date, agenda list, etc. are written in advance on the white board before the conference starts. In this embodiment, a specific participant (organizer) pre-describes documents necessary for the agenda in advance using handwritten drawing or a clean function such as FIG. The function to hold.

  In addition to characters and drawings, the information described in advance can be prepared as a process management table that is copied from a spreadsheet page. Of course, the line segment packet data stored up to the previous time may be drawn in the form of a continuation of the previous meeting.

  Here, although not shown in the figure, when a personal name is entered in the table as shown in FIG. 22, the name is written in the personal name icon shown in FIG. Providing a UI that can be filled in directly by bringing it to “Member” is convenient. All of these can be realized by processing of the graphic input / display device application.

  FIG. 23 is an explanatory diagram showing the internal structure of the terminal when a conversation is performed only between specific terminals during a conference using the graphic input / display device and the mobile device component according to the present invention.

  In the present embodiment, the configuration of data in the terminal and the data flow when the conversation between the specific terminals described in FIG. 9 is performed are shown. The left first terminal application includes a line segment data packet 1100001, and the right second terminal application includes a line segment data packet 1100003, which are described in FIG. This is a data packet storing drawing data to be displayed on a white board shared and held by an attached terminal.

  In the present embodiment, in addition to this data packet, a line segment data packet (2300001) in which the first terminal and the second terminal store the line drawing described on the chat board described in FIG. , 2300011). This data packet is independent of the data packet that stores the drawing data to be displayed on the white board, and the conversation by the line drawing between the first terminal and the second terminal without being displayed on the white board. A data packet to be recorded.

  These data packets (2300001, 2300011) are held by the number of terminals of the other party when having conversations with a plurality of terminals at the same time as the terminals on the right side of FIG. 9 (d).

  Further, the line segment data packet indicating the line drawing described on the chat board is shared by all the members in the same way as the batch drawing operation shown in FIG. By transmitting to the white board data, it can be displayed on the white board and the screens of everyone's terminals, and can be stored in the line segment data packet as conference proceedings data.

  FIG. 24 is an explanatory diagram showing operations related to automatic scale change of the figure input / display device and portable terminal according to the present invention.

  In this embodiment, the size of the white board image shared by all the participants in the conference is not a fixed pixel size corresponding to the size of the mobile terminal or the white board, but shows an operation when the image size is larger. It is a thing.

  FIG. 24A shows the screen of the terminal device with a touch panel described so far. Here, when a line is further drawn as shown in FIG. 24 (b) and a line that extends beyond the screen of FIG. 24 (a) is drawn, the screen of the terminal device with the touch panel automatically scrolls, Fill in a large image size white board.

  At this time, as shown in FIG. 24C, the white board image projected by the projector is automatically reduced in size so that the entire drawn line image is displayed. Other terminals automatically change to the reduced display as well as the white board, but it is also possible to switch to the enlarged display from the menu (not shown) of each terminal, and each terminal gives an instruction for the enlarged display, It is also possible to switch from a reduced display as shown in FIG. 24C to an enlarged display similar to the terminal display shown in FIG.

  FIG. 25 is an explanatory diagram showing a participant confirmation operation using a camera in the figure input / display apparatus and portable terminal according to the present invention.

  The operations of the intelligent liquid crystal projector 10010 and the terminals with touch panels (10040 to 10070) used by the conference participants are the same as those in FIG.

  In this embodiment, an icon 10012 indicating the status of each touch panel terminal (10040 to 10070) of the participant 250002 is taken by a camera 250001 built in or attached to the touch panel terminal (10040 to 10070) used by each participant. The participant's own image is displayed.

  This image may be a still image taken once at the start of the meeting, or a moving image taken at all times during the meeting, and all the participants' faces will be displayed as shared information, Everyone can check to see if there are any people who should not participate.

  FIG. 26 is an explanatory diagram showing a specific operation of the camera unit for confirming a participant using a camera in the figure input / display apparatus and portable terminal according to the present invention.

  As shown in FIG. 26 (a), the touch panel-equipped terminal 10070 in this embodiment has a built-in or mountable camera 25001 on the touch panel side so that it can be used for other purposes such as a video phone. . The orientation of the camera 25001 is normally fixed without moving, and the number of parts is reduced.In that case, the shooting angle of view 26001 is considerably wider by a wide-angle lens so that the range captured by the camera 25001 is not so limited. You can shoot.

  When a participant is photographed with this camera, as shown in FIG. 26 (b), the participant 250002 appears in a considerably small size with respect to the photographing area 260002 of the camera. In this embodiment, a technique known as a camera face detection function is used to extract and cut out a video 260003 near the participant's face in the shooting area 260002 and display it on the icon 10012 shown in FIG. . This makes it possible for each participant to check the face of the participant by effectively utilizing the area of the small icon compared to the entire screen.

  As shown in FIG. 25, the captured image may be a still image or a moving image, and if it is a still image, the degree of occupation of the communication traffic in the image transfer may be temporary at the start of the conference. In the case of moving images, other participants may also check the status of participants changing during the meeting and which participants are paying attention to the presentation and whiteboard contents at that time. It is possible to promote the conference more smoothly.

  This embodiment can also be expressed as follows. That is, a program that is installed in a mobile terminal and executed to communicate with other mobile terminals and projectors specified by identification information, and divides line drawing information input from the touch panel into line segments at predetermined intervals. Control the touch panel means, the display means and the transmission / reception means so as to generate a line segment data packet together with attribute information such as the coordinate value of the start and end points of the line segment and the type and color of the drawing line, and to transmit to the projector, This display means displays the user information of the other portable terminal identified by the previous identification information, identifies the user information, divides the line drawing information input from the touch panel into line segments at predetermined intervals, and A line segment data packet is generated together with the coordinate values of the start point and end point of the line segment and attribute information such as the type and color of the drawing line, and transmitted to the user of the other portable terminal. The touch panel means, the display means and the transmission / reception means may be controlled to function as a program for controlling the display means and the transmission / reception means so as to display received data from the user of the other portable terminal identified by the identification information on the display means. it can. In the above program, data distributed from the other portable terminal or projector on a plurality of portable terminals is stored in a memory in the terminal, and drawn by a line segment data packet by operation of the portable terminal. It may be a program that can execute a function of playing back a process in which a line to be extended returns to the past along the time axis. Moreover, it is the above-mentioned program, Comprising: The direct communication exchanged only between the 1st portable terminal which is arbitrary terminals among the several portable terminals, and the 2nd portable terminal which is also an arbitrary terminal is performed. The second mobile terminal program that receives the call has a function that responds to the call processing by the first mobile terminal program, and the first terminal and the second mobile terminal The terminal program uses the touch panel and display on the terminal from the time when the calling process and response are completed, and includes attribute information such as the coordinate values of the start and end points of the characters and graphics, the type of drawing line, and the color. A function of transmitting and receiving data only between the terminals may be executable. In addition, the above-described program, which is a list of IDs of mobile terminals connected to the network, any of ID numbers, colors, patterns, and images on the screen of the mobile terminal that executes the program, A function of displaying using a plurality of functions may be executable. Further, in the above-described program, when the camera is built in or mounted on the mobile terminal in a direction facing the user, the program controls the camera to shoot a video that can identify the user. In the list of IDs of the displayed mobile terminals, a function of displaying an image that can identify a user who uses the touch panel may be executable. In addition, in the above-described program, a video that can be identified by a user, which is captured by a camera built in or mounted on a mobile terminal, is automatically extracted from a captured image by identifying a part that can identify the user. A configuration capable of executing processing for generating and using video may be used. Note that the above-described program is an example of the present embodiment, and the configuration executed by the program having the hardware configuration of the present embodiment as a software configuration is of course included in the present embodiment.

10010 Intelligent LCD projector 10040 Terminal with touch panel 20040 Line segment packet data

Claims (3)

A system including a plurality of portable terminals and a projector device capable of communicating with the plurality of portable terminals,
The projector device includes:
A projector unit for projecting an image;
A communication department;
A storage unit;
A control unit,
One mobile terminal of the plurality of mobile terminals is:
A display unit;
A touch panel unit;
A communication department;
A storage unit;
A control unit;
With
Each of the plurality of portable terminals has a drawing line type data for drawing a character and a figure and an erasing line type data for erasing the character and the figure, which are generated based on an operation input received by the touch panel unit. These two types of data can be sequentially transmitted to the projector device,
The projector device receives drawing line type data and erasing line type data received from the plurality of portable terminals, and stores the series of drawing line type data and erasing line type data in the storage unit of the projector device. Memorize the time series in a discernible state,
In the control state by the control unit of the projector device,
Based on the drawing line type data and the erasing line type data received from the plurality of portable terminals, a display image as a result of sequentially drawing or erasing characters and figures is sequentially updated and projected from the projector unit, and the projector The one portable terminal sequentially in a state in which the line type data for drawing and the line type data for erasure received from the plurality of portable terminals, not the display image itself, can be discriminated in time series via the communication unit of the apparatus A first control state to be transmitted to each of the plurality of terminals including:
Using a series of drawing line type data and erasing line type data stored in the storage unit of the projector device in a state in which the time series can be determined, at a point in the middle of tracing the time series time axis There is a second control state in which a display image of characters and figures is generated and projected from the projector unit,
The one portable terminal is:
The drawing line type data and the erasing line type data sequentially transmitted in a state in which the time series can be determined from the projector device are stored in the storage unit of the one portable terminal in a state in which the time series can be determined,
In the control state of the one mobile terminal by the control unit of the one mobile terminal,
A third control state in which a display image obtained by sequentially drawing or erasing characters and figures based on the drawing line type data and the erasing line type data received from the projector device is displayed on the display unit;
Using a series of drawing line type data and erasing line type data stored in a state in which the time series can be discriminated in the storage unit of the one mobile terminal, the time series in the middle of tracing back the time series There is a fourth control state in which display images of characters and figures at the time are generated and displayed on the display unit.
A system characterized by that. A plurality of portable terminals and a projector device capable of communicating with the plurality of portable terminals,
A projector unit for projecting an image;
A communication department;
A storage unit;
A control unit,
The communication unit transmits two types of data: drawing line type data for drawing characters and figures and erasing line type data for erasing characters and figures, which are sequentially transmitted from each of the plurality of mobile terminals. Can receive
The storage unit receives the drawing line type data and the erasing line type data received from the plurality of portable terminals in a state in which the series of the drawing line type data and the erasing line type data can be distinguished in time series. Remember,
In the control state by the control unit,
Based on the drawing line type data and the erasing line type data received from the plurality of portable terminals, a display image as a result of sequentially drawing or erasing characters and figures is sequentially updated and projected from the projector unit, and the communication The plurality of line-type data for drawing and the line-type data for erasure received from the plurality of portable terminals, not the display image itself, via the unit, sequentially including the one portable terminal in a state in which time series can be distinguished. A first control state to be transmitted to each of the mobile terminals;
Using a series of drawing line type data and erasing line type data stored in a state in which the time series can be discriminated in the storage unit, characters and figures at a point in the middle of going back the time axis of the time series There is a second control state in which a display image is generated and projected from the projector unit.
A projector device characterized by that. A portable terminal capable of communicating with a projector device,
A display unit;
A touch panel unit;
A communication department;
A storage unit;
A control unit;
With
The communication unit has two types of drawing line type data for drawing characters and figures and erasing line type data for erasing characters and figures, which are generated based on operation inputs received by the touch panel unit. Can be sequentially transmitted to the projector device,
The communication unit sequentially receives drawing line type data and erasing line type data that the projector apparatus receives from each of a plurality of portable terminals including the portable terminal and transmits to the portable terminal from the projector apparatus,
The storage unit stores the received drawing line type data and the erasing line type data in a state in which the time series can be distinguished,
In the control state of the one mobile terminal by the control unit,
A first control state in which a display image as a result of sequentially drawing or erasing characters and figures is sequentially updated and displayed on the display unit based on the drawing line type data and the erasing line type data received from the projector device; ,
Using a series of drawing line type data and erasing line type data stored in a state in which the time series can be discriminated in the storage unit of the one mobile terminal, the time series in the middle of tracing back the time series There is a second control state in which a display image of characters and figures at the time is generated and displayed on the display unit.
A portable terminal characterized by that.

Images