JP2016110550A - Information output control device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce and output information input in the case of associating an output object with a predetermined area where the output object is placed by using the association as a condition.SOLUTION: An information output control device (projector device) 1 includes an output information memory for storing information (input voice information) input from a microphone 5 while an output object (electronic paper 2) is placed in an external predetermined area (projection enabling area 3) in association with the output object, and when the output object is placed in the predetermined area again, reads input information stored in association with the output object from the output information memory, and reproduces and outputs the information from a speaker 6.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information output control device and a program for outputting information.

  In general, as an information output control device that outputs information, for example, a projector device that projects and displays an image on an external projection target (output target: screen) is used to output various materials (images). When a presentation is made by projecting on a (screen), the presenter or the like instructs the necessary part on the screen while explaining the supplementary explanations and cautions in accordance with the materials on the screen. . In such a case, conventionally, a technique is known in which an instruction locus of a pen on an image being projected is projected onto the image being projected (see Patent Document 1). Furthermore, regarding projection, a technique (see Patent Document 2) in which an image is projected onto a moving object by projection mapping is also known.

JP 2003-78686 A JP 2013-192189 A

  However, the technique of Patent Document 1 described above uses the screen of the electronic blackboard as the projection target, but simply specifies the position on the device operated by the pen. It did not specify whether to display the display information of the correct contents. In addition, the technique disclosed in Patent Document 2 described above is to project and display changes in the position and shape of an output object, and to specify what display information is to be projected and displayed. It wasn't something to do. Note that this is not limited to the projector apparatus, and the same problem occurs in other information output control apparatuses.

  An object of the present invention is to make it possible to reproduce and output information input in association with an output object and a predetermined area where the output object is placed, on the condition of the association.

In order to solve the above-described problems, the present invention
An information output control device that outputs information,
Input information acquisition means for acquiring input information;
A specifying means for specifying a predetermined output object placed in a predetermined area outside the control device;
Information storage means for storing the input information acquired by the input information acquisition means in association with the output object while the output object specified by the specification means actually exists in the predetermined area;
Output control means for reading out and reproducing the input information stored in association with the output object when the output object is placed again in the predetermined area;
It is characterized by providing.

  According to the present invention, it is possible to reproduce and output information input in association with an output object and a predetermined area where the output object is placed, on the condition of the association.

The figure which showed the usage example of the projector apparatus with a camera function applied as an information output control apparatus. The block diagram which showed the basic component of the projector apparatus with a camera function. (1)-(5) is a figure for demonstrating the projection content displayed in relation to the electronic paper 2 set | placed in the projectable area 3, and the input / output state of an audio | voice. The figure for demonstrating the output information memory M3. 6 is a flowchart for explaining an operation (characteristic operation of the first embodiment) of the projector apparatus 1 with a camera that is started in response to power-on. 6 is a flowchart following the operation of FIG. The figure which showed the usage example of the information output control apparatus (notebook-type PC) 100 in 2nd Embodiment. The block diagram which showed the fundamental component of notebook type PC100, the display device 200, and the portable terminal device 300 in 2nd Embodiment. (1)-(4) is a figure for demonstrating the display content in the state in which the portable terminal device 300 was placed on the display device 200 in 2nd Embodiment. The figure for demonstrating the output information memory M3 of 2nd Embodiment. In the second embodiment, a flowchart that is started when a “display device control mode” for controlling display on the display device 200 is selected. 12 is a flowchart following the operation of FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
1st Embodiment illustrated the case where it applies to the projector apparatus with a camera as an information output control apparatus which outputs display information, and FIG. 1 is the figure which showed the usage example of this projector apparatus with a camera function. .
The information output control device (projector device with camera) 1 has a camera function, a communication function, and the like in addition to the projector function. For example, the projector device 1 displays a document on a desk while posting a document on a desk in a counter service such as a financial institution, or displays a document on a desk in a meeting room. When a participant is in a meeting, the entire desk is photographed or projected and is fixedly arranged on the ceiling or wall of the room.

  That is, the projector device 1 with a camera irradiates light according to display information onto an output target object (electronic paper 2) existing on the desk surface to project and display it, or shoots the entire desk surface. To do. The illustrated example shows a state in which electronic paper 2 as a material and other objects (for example, a mobile terminal device 4) are placed in a predetermined area (projectable area) 3 on a desk in a window service. As shown, the projector apparatus 1 discriminates the electronic paper 2 from other objects by analyzing an image obtained by photographing a predetermined area (projectable area) 3 on the desk surface.

  The electronic paper 2 is an output object that is a target when displaying the display information unique to the electronic paper 2, that is, an output object that actually exists outside the projector apparatus 1, and information displayed on the electronic paper 2. Is a window business document. For example, confidential information such as personal information, or real-time information such as stock price and sales status is projected and displayed on the electronic paper 2 from the projector device 1. That is, as will be described in detail later, when the electronic paper 2 is placed in a predetermined area (projectable area) 3 on the desk surface, the projector device 1 is stored in advance in association with the electronic paper 2. The display information is output so as to be displayed in association with the electronic paper 2 in the projectable area 3, but when the electronic paper 2 is separated from the projectable area 3. Controls to delete the projection display of the display information.

  The electronic paper 2 is constituted by, for example, a microcapsule type electronic paper (electrophoretic display) using an electrophoretic phenomenon, and a medium in which colored charged particles (charged bodies) are filled between a pair of opposed electrodes. Are arranged, and when a voltage is applied between the pair of electrodes, the charged particles in the medium move in a direction corresponding to the applied voltage to perform display. In addition, microphones 5 and speakers 6 with high directivity are disposed at each peripheral edge (four edges) of the rectangular desk surface.

  The projectable area 3 on the desk surface is a photographable area, and the projector apparatus 1 analyzes the image photographed in the projectable area 3 so that the electronic paper 2 actually exists in the area 3. When this is recognized, an operation of projecting and displaying display information unique to the paper in association with the electronic paper 2 is started. Note that the projector device 1 has a function of adjusting the projection direction (irradiation direction) in the direction of the position when the position where the electronic paper 2 actually exists is identified from the image obtained by photographing the projectable area 3.

  That is, the projector device 1 is provided with a projection direction adjustment function (not shown), and the projection direction is set within the range of the projectable area 3 by driving the optical system according to the actual position of the electronic paper 2. It can be freely adjusted. In addition, when the projector apparatus 1 starts a projection operation on the electronic paper 2 that actually exists in the projectable area 3, the electronic paper 2 is projected in the projectable area 3 while analyzing an image of the projectable area 3. As described above, when it is detected that the user has left the area 3, the projection operation for the electronic paper 2 is stopped (the projection display is erased). I have to.

FIG. 2 is a block diagram showing basic components of the information output control device (projector device with camera) 1.
The projector device 1 has a CPU 11 as a core, and the CPU 11 is a central processing unit that controls the overall operation of the projector device 1 in accordance with various programs in the storage unit 12. The storage unit 12 includes, for example, a ROM, a flash memory, and the like, and has a program memory M1 that stores a program for realizing the present embodiment in accordance with the operation procedure illustrated in FIGS. 1 has a work memory M2 for temporarily storing various data (time measurement time, timer measurement time, flag, etc.) required by 1 and an output information memory M3 described later. The storage unit 12 may be configured to include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a communication network via a communication function (not shown). In such a state, a storage area on a predetermined server device side may be included.

  The CPU 11 is connected with an operation unit 13, an external connection unit 14, a communication unit 15, a camera unit 16, a projector unit 17, and the like as input / output devices. The CPU 11 determines each input / output device according to an input / output program. Control. The operation unit 13 includes a power button, a projection adjustment button, and the like. The external connection unit 14 is a connector unit to which an external device (not shown) such as a personal computer (PC) or a recording medium is connected. The communication unit 15 is a communication interface that is connected to an external device through, for example, a wireless LAN (Local Area Network) or Bluetooth (registered trademark) communication, and transmits and receives audio information between the microphone 5 and the speaker 6 described above. I do.

  The camera unit 16 constitutes the above-described photographing function. In addition to a photographing lens (not shown), a lens / mirror block such as a mirror, an image sensor, and a driving system thereof, a distance measuring sensor, a light amount sensor, an analog processing circuit, a signal processing The circuit has a circuit, a compression / decompression circuit, etc., and is provided with an auto-other function for automatically focusing, a zoom function for controlling the photographing range, and the like. The projector unit 17 constitutes the projector function described above, and includes a projection light 17a that is turned on when power is supplied, a transmissive liquid crystal panel 17b that projects an image to be projected, and a projection lens 17c. A light source adjustment unit 17d that controls the light 17a and adjusts its on / off and brightness, a drive unit 17e that drives the transmissive liquid crystal panel 17b, and a lens adjustment unit that adjusts the focus and zoom of the projection lens 17c 17f and the like. The optical axis direction of the photographing lens of the camera unit 16 matches the optical axis direction of the projection lens 17c, and the above-described projectable area 3 can be photographed.

FIG. 3 is a diagram for explaining the input / output status of the projection content and the sound displayed in association with the electronic paper 2 placed in the projectable area 3.
When the output object (electronic paper 2) is placed in a predetermined area (projectable area 3), the projector device 1 according to the first embodiment outputs display information associated with the electronic paper 2 as output information. When read out from the memory M3 and projected and displayed, if any audio information is input while the electronic paper 2 exists in the projectable area 3, the input audio information is associated with the electronic paper 2. Are registered in the output information memory M3, and then the audio information corresponding to the electronic paper 2 is read from the output information memory M3 and reproduced and output at the timing when the electronic paper 2 is again placed in the projectable area 3. I am doing so.

  FIG. 3A is a diagram showing information fixedly displayed as a title by the electronic paper 2 itself, for example, “world stock prices and exchange rates”. The electronic paper 2 is a projectable area on the desk. When placed in the projector 3, the projector device 1 reads out display information stored corresponding to the electronic paper 2 and projects and displays it on the electronic paper 2 in the projectable area 3. FIG. 3 (2) shows a state of projection display, and is a case where the detailed text information is projected and displayed on the electronic paper 2 following the title “World Stock Price and Exchange”.

  While the electronic paper 2 is actually present in the projectable area 3, the CPU 11 receives the input sound collected by the highly directional microphone 5 and outputs the sound information together with the identification information of the electronic paper 2. Recording is performed in the information memory M3. In this case, with reference to the direction of the electronic paper 2 in the projectable area 3 (for example, the front direction), it is determined from which direction or position the sound is input, and the input direction or position of the sound is input to the sound. Information indicating the origin is stored in the output information memory M3 together with the input audio information. The audio information stored in the output information memory M3 is based on information indicating an input source stored corresponding to the electronic paper 2 when the electronic paper 2 is placed in the projectable area 3 again. Thus, the output destination of the sound information is determined, and the sound is output from the speaker 6 having high directivity disposed in the direction or position of the output destination. In general, the voice information means information of sound emitted by a person through a voice organ, but in the first embodiment, it means a generic name of sounds emitted by a person.

  FIG. 3 (3) is a diagram showing a case where the electronic paper 2 is again placed in the projectable area 3 after voice input as described above. When the electronic paper 2 is again placed in the projectable area 3, the projector device 1 recognizes the electronic paper 2, reads out the display information from the output information memory M 3, projects it, and reads out the audio information. At the same time, the output destination of the audio information is determined, and the audio information is output from the output destination speaker 6. FIG. 3 (4) shows a case where the same direction or position as the voice input direction or position shown in FIG. 3 (2) is determined as an output destination, and FIG. 3 (5) is shown in FIG. 3 (2). This shows a case where the direction or position opposite to the input direction or position of the voice is determined as the output destination.

FIG. 4 is a diagram for explaining the output information memory M3.
The output information memory M3 stores and manages display information and input voice information in association with a plurality of output objects (electronic paper 2). “Paper identification information”, “display information”, “input voice information” , “Input direction / input position”, and “output flag”. The “paper identification information” is information for identifying each electronic paper 2 and includes items of “identification image” and “ID”. The “identification image” is an image obtained by extracting a part of the electronic paper 2 from an image obtained by photographing the projectable area 3. For example, the display content such as a title name displayed on the electronic paper 2 is used as identification information. It is. “ID” is numeric string data (for example, a serial number) generated to identify each individual electronic paper 2.

  “Display information” is display information stored in advance corresponding to the electronic paper 2, for example, the detailed contents corresponding to the electronic paper 2 displaying “World Stock Price and Exchange” as the title name. The body information indicating “display information”. The “input voice information” is voice information that is input and recorded while the electronic paper 2 actually exists in the projectable area 3. “Input direction / input position” is an input source that indicates where the input sound is input. In the example of FIG. 1, each microphone 5 and speaker arranged on the four edges of the desk surface. Is divided into four directions / positions (up / down / left / right), one of up / down / left / right is stored as an input source. The “output flag” is a flag indicating that the electronic paper 2 is being projected and displayed in association with the electronic paper 2.

  Next, the operation concept of the information output control apparatus (projector apparatus with a camera) 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIGS. 5 and 6 are flowcharts for explaining the operation of the projector device 1 (characteristic operation of the first embodiment) that is started in response to power-on. The characteristic operation of the first embodiment will be specifically described below with reference to FIG.
First, the CPU 11 of the projector device 1 activates the camera unit 16 in response to power-on, starts photographing in the projectable area 3 on the desk surface, and sequentially captures the photographed images (step A1 in FIG. 5). . Then, while sequentially acquiring captured images in the projectable area 3 and performing image analysis (step A2), it is checked whether the electronic paper 2 is placed in the projectable area 3 (step A3), It is checked whether or not the electronic paper 2 has been released (step A4).

  That is, whether the electronic paper 2 has entered or exited the projectable area 3 is checked by recognizing an image of the shape and size of the electronic paper 2 and an identification mark added to the electronic paper 2. At that time, the timing of putting in and out the electronic paper 2 is detected while comparing a plurality of consecutive captured images (steps A3 and A4). Here, if the insertion / extraction of the electronic paper 2 is not detected (NO in Steps A3 and A4), the process proceeds to the flow of FIG. 6 on the condition that the electronic paper 2 actually exists in the projectable area 3 (Step A16). ), The output signal from each microphone 5 is received (step A17), frequency analysis is performed, and it is examined from which microphone 5 audio information of a predetermined sound volume (level) or more has been input (step A18). If no audio information is input from any microphone 5 (NO in step A18), the process returns to step A2 in FIG.

  If it is detected that the electronic paper 2 is placed in the projectable area 3 as shown in FIG. 3 (1) (YES in step A3), the electronic paper 2 is picked up from an image obtained by photographing the projectable area 3. Is extracted (step A5), the output information memory M3 is searched based on this paper image, and whether the electronic paper 2 is registered, that is, the paper image is the output information memory M3. Whether it is stored in the “identification image” of “paper identification information” (step A6). If the electronic paper 2 is not registered (NO in step A6), the process returns to step A2 to ignore the unregistered electronic paper 2, but the registered electronic paper (registered paper) 2 If so ("YES" at step A6), the "display information" of the registered paper 2 is read out from the output information memory M3 (step A7), and the actual position of the registered paper 2 is detected and acquired (step A8). In this case, the position where the electronic paper 2 actually exists (the position in the plane coordinate system) is detected and acquired from the reference point (for example, the upper left corner) in the projectable area 3.

  Then, an operation of projecting and displaying the “display information” acquired as described above at the detection position (actual position) is started, and the “output flag” is turned on (step A9). With such projection display, the display content of the electronic paper 2 changes from the state shown in FIG. 3A to the state shown in FIG. Next, it is checked whether or not “input voice information” is stored in the output information memory M3 corresponding to the registered paper 2 (step A10). If “input voice information” is not stored (NO in step A10), The process returns to step A2.

  Assuming that audio information is input from any microphone 8 in a state where information is projected and displayed on the electronic paper 2 that actually exists in the projectable area 3 as shown in FIG. Since it is determined in step A18 in FIG. 6 that there is a voice input, the process proceeds to step A19, and the voice input source is specified based on the output signal (microphone signal) from each microphone 5 (step A19). That is, the output signal (microphone signal) from each microphone 5 is frequency-analyzed to identify the microphone 5 having the highest level (sound pressure), and the microphone 5 with reference to the direction of the electronic paper 2 in the projectable area 3. Is specified as the voice input direction or position (input source information). Then, the input voice information is acquired (step A20), and paper identification information having the paper image as “identification image” and the updated serial number as “ID” is generated (step A21). Then, the input voice information and the input source information are registered in the “input voice information” of the output information memory M3 in association with the “paper identification information” (step A22). Then, it returns to step A2 of FIG.

  After registering the voice information input in association with the electronic paper 2 in this way, if the electronic paper 2 is separated from the projectable area 3 (YES in step A4), the process proceeds to the next step A13, Check whether the “output flag” is turned on. If the “output flag” is not turned on (NO in step A13), the process returns to the above-described step A2, but in this case, the “output flag” is turned on (YES in step A13). Proceeding to the next step A14, the projection display is terminated. As a result, the projection display is erased, and the display content of the electronic paper 2 shifts from the display state of FIG. 3 (2) to the display state of FIG. 3 (1). Thereafter, the “output flag” is turned off (step A15), and then the process returns to step A2.

  After the audio information is input as described above, when the electronic paper 2 on which information such as the title name is displayed is placed again in the projectable area 3 as shown in FIG. On the condition that the electronic paper 2 is registered in the output information memory M3 (step A6), “display information” corresponding to the registered paper 2 is read out from the output information memory M3 and projected and displayed. (Steps A7 to A9). Then, it is checked whether or not “input voice information” is registered corresponding to the registered paper 2 (step A10). In this case, since it is registered (YES in step A10), the “input voice information” corresponding to the registered paper 2 is checked. Information ”and“ input direction or input position ”are read out, and the output destination speaker 6 is determined based on this“ input direction or input position ”(step A11).

  Here, when determining the output destination speaker 6, the CPU 11 determines the same direction or position as the output destination for the input direction or position, or determines the opposite direction or position as the output destination, Of the three types of whether the direction or position arbitrarily set by the user operation is determined as the output destination, the output destination is determined based on the type arbitrarily selected in advance by the user operation. FIG. 3 (4) shows a case where the same direction or position as the voice input direction or position shown in FIG. 3 (2) is determined as the output destination. FIG. 3 (5) shows a case where the direction or position opposite to the voice input direction or position shown in FIG. 3 (2) is determined as the output destination. When the output destination is determined in this way, “input voice information” is generated and output from the speaker 6 of the determined output destination (step A12). Thereafter, the process returns to step A2.

  As described above, the information output control device (projector device) 1 in the first embodiment is input while the output object (electronic paper 2) is placed in the predetermined external area (projectable area 3). Output information memory M3 for storing the information (input voice information) in association with the electronic paper 2, and when the electronic paper 2 is placed in the projectable area 3 again, the information is associated with the electronic paper 2. Since the stored input voice information is read from the output information memory M3 and reproduced and output, the voice information input by associating the electronic paper 2 and the projectable area 3 is reproduced and output on the condition of the association. Can do. Therefore, by simply placing the electronic paper 2 in the projectable area 3, for example, it is possible to reproduce and output a customer's opinion or a meeting participant's opinion in the window service.

  The CPU 11 of the projector apparatus 1 ends the reproduction output of the input information when it becomes impossible to specify that the electronic paper 2 actually exists in the projectable area 3. The input information can be reproduced and output on condition that the paper 2 actually exists.

  The CPU 11 determines in which direction or position the input information is input with reference to the electronic paper 2 in the projectable area 3, and the determination result corresponds to the electronic paper 2 as information indicating the input source. At the same time, when the input information is reproduced and output, the output direction or position is determined based on the information indicating the input source, and the determined direction or position is reproduced as the output destination. Since the output is made, the output destination can be changed based on the input source instead of fixing the output destination.

  When determining the output destination based on the information indicating the input source, the CPU 11 selects either the same direction or position, the opposite direction or position, or the arbitrarily set direction or position with respect to the input direction or position. Since it is determined as the output destination, for example, if the same direction or position is determined as the output destination with respect to the input direction or position, the input information that is reproduced and output is, When there is a customer or when there are a plurality of participants in a meeting, it is possible to easily confirm which customer or participant has the opinion. In addition, if the direction or position opposite to the input direction or position is determined as the output destination, in the case of face-to-face meeting, the opinion of the face-to-face partner can be heard up close. Further, if the direction or position arbitrarily set with respect to the input direction or position is determined as the output destination, opinions of a plurality of customers and participants can be gathered in one place and listened to up close.

  Since the identification information for identifying the electronic paper 2 that actually exists in the projectable area 3 is generated, the input information stored in association with this identification information is read from the output information memory M3 and reproduced and output. Correspondence between the electronic paper 2 and the input information becomes clear, and the input information can be reproduced and output for each electronic paper 2.

  In the above-described first embodiment, voice information is exemplified as input information. However, handwritten information may be input information, for example. That is, the movement of the finger or pen may be photographed by the camera unit 16, the photographed image may be analyzed, handwritten information may be generated from the indicated locus, and registered in the output information memory M3. Further, the present invention is not limited to the case where handwritten information is input by the movement of a finger or a pen. For example, information that is arbitrarily handwritten in electronic paper by an electromagnetic induction electronic pen on electronic paper 2 that is supplied with power. The captured image may be captured by 16 and the captured image may be analyzed and registered as input information in the output information memory M3. Even if information is written in the electronic paper 2 with the electromagnetic induction electronic pen as described above, the handwritten information may be erased from the electronic paper 2 later. Even if the handwritten information is erased from the electronic paper 2 in this way, the handwritten information is then projected into the electronic paper 2 by placing the electronic paper 2 again in a predetermined area (projectable area 3). Displayed (reproduced output).

  Further, when the electronic paper switches and displays each page of a magazine or the like, for example, when an additional writing operation is performed on the electronic paper displaying the first page, the display content of the first page is identified. As a key, handwritten information is stored in association with the first page, and when the electronic paper displaying the first page is placed next time, the handwritten information stored in association with the page is stored. Read the information displayed on the first page as the identification key and add it to the page. The same applies to the second and subsequent pages. The information displayed on each page is the key for page identification. You may make it add the handwritten information for every page whenever a page is switched and displayed.

  In the embodiment described above, the electronic paper 2 is exemplified as the output object. However, for example, other display devices such as a touch screen, a liquid crystal panel, and an organic EL (Electro Luminescence) display, or a magazine, a notebook, an ornament, It may be a simple object such as a decoration or a piece of paper. In this case, an image may be projected and displayed on the object by projection mapping.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, the projector device 1 is used as the information output control device, the electronic paper 2 is used as the output object, the projectable area 3 on the desk is used as the predetermined area, and the audio information is used as the input information. In the second embodiment, a notebook PC (personal computer) is used as the information output control device, the electronic paper 2 of the projection object is used as the output object, a display device on the desk is used as the predetermined area, and handwritten information is used as the input information. It is a thing. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7 is a diagram showing an example of using a notebook PC.
The information output control device (notebook type PC) 100 is displayed on the display device 200 laid on the desk when the person in charge and the customer face each other while posting the material on the desk in the window service. In addition to various basic functions, the communication device is provided with a communication function for performing short-range communication with the display device 200 and the mobile terminal device 300. The display device 200 is a sheet-like touch screen laid on the entire surface of a desk within a predetermined area. The display device 200 has a sheet-like liquid crystal panel (not shown) having the size of the desk surface, The touch panel has the same shape and the same size (not shown) arranged in layers. Note that the touch screen constituting the display device 200 may be any system such as a matrix switch system, a resistive film system, a capacitance system, an electromagnetic induction system, or an infrared shielding system. The display device (touch screen) 102 has a communication function for performing short-distance communication with the notebook PC 100.

  When an arbitrary portable terminal device 300 is placed on the display device 200, the display device 200 detects that the portable terminal device 300 is placed and gives a terminal detection signal to the notebook PC 100. The notebook PC 100 recognizes the portable terminal device 300 as an output object in response to the terminal detection signal from the display device 200, and the display information associated with the portable terminal device 300 is the portable terminal device 300. The display on the display device 200 is controlled so as to be displayed in the vicinity of the. The customer or the person in charge performs a face-to-face meeting while viewing the display contents (documents) of the mobile terminal device 300 placed on the display device 200. At that time, the notebook PC 100 is placed on the display device 200 on the mobile terminal device 300. Is displayed, the display information is transmitted to the display device 200 in order to display the display information peculiar to the terminal in the vicinity of the portable terminal device 300 in the display device 200.

  The mobile terminal device 300 is an output target that is a target when displaying display information specific to the terminal in its vicinity, that is, an output target that actually exists outside the notebook PC 100, for example, a tablet terminal , Smartphones, PDAs (personal portable information communication devices), and the like. When the portable terminal device 30010 is placed at an arbitrary position on the display device 200 in a state where display information such as conference materials is displayed on the output object (the portable terminal device 300), the display device 200 The contact position (the actual position of the mobile terminal device 300) where the mobile terminal device 300 is placed is detected from the contact state and transmitted to the notebook PC 100. The mobile terminal device 300 also has its own terminal identification information (terminal ID). Is transmitted and output to the notebook PC 100.

  The mobile terminal device 300 periodically transmits and outputs its own terminal identification information (terminal ID) by a user operation while being placed on the display device 200. When the notebook PC 100 receives the terminal ID from the mobile terminal device 300, the notebook PC 100 specifies the mobile terminal device 300 placed on the display device 200, and receives the actual position of the mobile terminal device 300 from the display device 200. Based on the actual position, a position in the vicinity of the mobile terminal device 300 (a position for displaying terminal-specific display information) is specified.

FIG. 8 is a block diagram illustrating basic components of the notebook PC 100, the display device 200, and the mobile terminal device 300.
The notebook PC 100 has a CPU 101 as a core, and the CPU 101 is a central processing unit that controls the overall operation of the notebook PC 100 according to various programs in the storage unit 102. The storage unit 102 includes, for example, a ROM, a flash memory, etc., and a program memory M1 that stores a program for realizing the present embodiment in accordance with the operation procedure shown in FIGS. 11 and 12, and the notebook type It has a work memory M2 for temporarily storing various data (time measurement time, timer measurement time, flag, etc.) required by the PC 100, an output information memory M3 described later, and the like.

  In addition to the operation unit 103, the display unit 104, the external connection unit 105, the wide area communication unit 106, and the like as an input / output device, the CPU 101 is connected to a short-range communication unit 107. Therefore, each input / output device is controlled. The short-range communication unit 107 is a communication interface that is connected to the display device 200 or the mobile terminal device 300 via, for example, a wireless LAN (Local Area Network) or Bluetooth (registered trademark) communication.

  The display device 200 has the CPU 201 as a core, and the CPU 201 controls the entire operation of the display device 200 according to various programs in the storage unit 202. A touch screen 203, a short-range communication unit 204, and the like are connected to the CPU 201 as input / output devices, and the CPU 201 controls each input / output device according to an input / output program. The touch screen 203 may be any method such as a matrix switch method, a resistance film method, a capacitance method, an electromagnetic induction method, an infrared shielding method, or the like. The short-range communication unit 204 is a communication interface for communication connection with the notebook PC 100 via a wireless LAN or Bluetooth (registered trademark) communication.

  The mobile terminal device 300 has a CPU 301 as a core, and the CPU 301 controls the overall operation of the mobile terminal device 300 according to various programs in the storage unit 302. A touch screen 303, a short-range communication unit 304, and the like are connected to the CPU 301 as input / output devices, and the CPU 301 controls each input / output device according to an input / output program. The short-range communication unit 304 is a communication interface that connects and communicates with the notebook PC 100 via a wireless LAN or Bluetooth (registered trademark) communication.

FIG. 9 is a diagram for explaining display contents in a state where the mobile terminal device 300 is placed on the display device 200.
FIG. 9A illustrates a state in which the mobile terminal device 300 is displaying display information when the mobile terminal device 300 is placed on the display device 200. In the example shown in FIG. This shows a case where the mobile terminal device 300 displaying the self achievement status is placed on the display device 2060. FIG. 9 (2) shows a case where “A” indicating the higher rank as a business evaluation result is input by handwriting at an arbitrary position on the display device 200 in the state of FIG. 9 (1). When the notebook PC 100 receives and obtains information input by handwriting from the display device 200 while the mobile terminal device 300 actually exists on the display device 200, the notebook PC 100 associates the input information (handwritten information with the mobile terminal device 300). ) As display information in the output information memory M3.

  FIG. 9 (3) shows a case where the portable terminal device 300 having the display contents shown in FIG. 9 (1) is again placed on the display device 200 after handwritten input. The device 300 is specified, and the display information (handwritten input information) corresponding to the device 300 is read from the output information memory M3, transmitted to the display device 200, and displayed near the portable terminal device 300. FIG. 9 (4) shows a state in which “A” rank is additionally displayed as handwritten input information (business evaluation result) in the vicinity of the mobile terminal device 300. In this case, since the business evaluation is exemplified as the handwritten input information, the character string “rank” is additionally displayed after the input information “A”.

FIG. 10 is a diagram for explaining the output information memory M3.
The output information memory M3 stores and manages display information in association with a plurality of output objects (portable terminal devices 300), and includes “terminal identification information”, “display information (handwritten input information)”, “under output” Each item of “Flag” is included. The “terminal identification information” is ID information for identifying each mobile terminal device 300, and the “display information (handwritten input information)” is information input by handwriting on the display device 200. The “output flag” is a flag indicating that handwritten input information is being displayed in the vicinity of the mobile terminal device 300.

11 and 12 are flowcharts that are started when a “display device control mode” for controlling display on the display device 200 is selected. The characteristic operation of the second embodiment will be specifically described below with reference to FIG.
First, the notebook PC 100 checks whether or not the predetermined portable terminal device 300 is placed on the display device 200 (step B1 in FIG. 11), or checks whether or not the predetermined portable terminal device 300 is released from the display device 200. (Step B2). Here, when any object is placed, the display device 200 detects that the predetermined portable terminal device 300 is placed from the shape and size of the contact state, and when any object is left. It detects that the predetermined portable terminal device 300 has been separated from the shape and size of the contact state when the object has been in contact so far, and transmits the detection signal to the notebook PC 100.

  The notebook PC 100 does not receive the detection signal indicating that the predetermined mobile terminal device 300 is placed on the display device 200 and the detection signal indicating that the mobile terminal device 300 is separated (steps B1 and B2). ), The process proceeds to the flow of FIG. 12 to check whether the mobile terminal device 300 actually exists on the display device 200 (step B12). In this case, since the mobile terminal device 300 does not actually exist on the display device 200 (NO in step B12), the process returns to step A1 in FIG.

  As shown in FIG. 9A, when the mobile terminal device 300 is placed on the display device 200 (YES in step B1), the terminal ID transmitted from the mobile terminal device 300 is received ( Step B3). Then, “terminal identification information” in the output information memory M3 is searched based on the received terminal ID to check whether this terminal ID is registered (step B4). In this case, since it is not registered (NO in step B4), the process returns to step B1. Thereafter, since it is detected that the mobile terminal device 300 actually exists on the display device 200 (YES in step B12 in FIG. 12), the process proceeds to step B13, and whether or not the instruction operation presence signal has been received from the display device 200 is determined. Investigate.

  Here, if an instruction operation is not performed on the display device 200, that is, if an instruction operation presence signal is not received (NO in step B13), the process returns to step B1 in FIG. 11, but is shown in FIG. 9 (2). As described above, when an instruction operation is performed on the display device 200, that is, when an instruction operation presence signal is received from the display device 200 (YES in step B13), the process proceeds to step B14, and the mobile terminal device 300 The terminal ID transmitted and output from the terminal ID is received and terminal identification information is generated (step B14). Then, the instruction locus is received from the display device 200 (step B15), and the terminal ID and the instruction locus (handwritten input information) are registered in “terminal identification information” and “display information” in the output information memory M3 (step B15). ). Then, it returns to step B1 of FIG.

  After the handwritten input information is registered in this manner, if the mobile terminal device 300 is separated from the display device 200, this is detected in the above-described step B2, and the process proceeds to the next step B9 to output information. With reference to the memory M3, it is checked whether the “output flag” corresponding to the mobile terminal device 300 is turned on. In this case, the “output flag” is not turned on (NO in step B9). Return to step B1.

  Thereafter, as shown in FIG. 9 (3), when the portable terminal device 300 is again placed on the display device 200 (YES in step B1), the notebook PC 100 receives the terminal received in the next step B3. Since the ID is registered in the output information memory M3 (YES in step B4), it requests the display device 200 to detect the terminal position (step B5). Upon receiving this terminal position detection request, the display device 200 detects the contact position (the actual position of the mobile terminal device 300) where the mobile terminal device 300 is placed based on the contact state of the mobile terminal device 300. The position where the mobile terminal device 300 actually exists at the center or one corner of the contact surface of the mobile terminal device 300, starting from the reference point (for example, the upper left corner) in the display device 200 (the position of the plane coordinate system) ) Is detected.

  When the notebook PC 100 receives the terminal position detected on the display device 200 side (step B6), it reads “display information (handwritten input information)” of the terminal from the output information memory M3 (step B7), and receives the received terminal. The handwritten input information is transmitted to the display device 200 together with the actual position of the mobile terminal device to instruct that it should be displayed in the vicinity of the mobile terminal device 300, and the “output flag” corresponding to the terminal ID is turned on (step B8). ). As a result, on the display device 200 side, handwritten input information is displayed in the vicinity of the portable terminal device 300 as shown in FIG. In this case, as described above, the character string “rank” is additionally displayed after the handwritten input information “A”.

  Thereafter, when the mobile terminal device 300 is separated from the display device 200, this is detected in step B2, and the process proceeds to step B9. In this case, since the “output flag” is turned on (YES in step B9) ), The process proceeds to the next step B10, and the display device 200 is instructed to end the vicinity display. As a result, the near display on the display device 200 is erased. Thereafter, the “output flag” is turned off (step B11), and then the process returns to step B1.

  As described above, the information output control device (notebook PC) 100 according to the second embodiment is input while the output object (mobile terminal device 300) is placed in the predetermined external area (display device 200). Output information memory M3 that stores the information (handwritten input information) associated with the portable terminal device 300 and stores the portable terminal device 300 in the display device 200 again when the portable terminal device 300 is placed in the display device 200. Since the handwritten input information stored in association with each other is read from the output information memory M3 and reproduced and output, the handwritten information input in association with the mobile terminal device 300 and the display device 200 on which the portable terminal device 300 is placed is associated therewith. Can be reproduced and output as a condition.

  When the notebook PC 100 receives and acquires the actual position of the mobile terminal device 300 on the display device 200, the notebook PC 100 determines a position to be reproduced and output on the display device 200 based on the actual position, and reproduces and outputs at the determined output position. Therefore, even if the mobile terminal device 300 is placed at an arbitrary position on the display device 200, reproduction output at the position of the mobile terminal device 300 is possible.

  In the second embodiment described above, handwritten input information on the display device (touch screen) 200 is registered in the output information memory M3. However, an image obtained by photographing the movement of the finger or pen is analyzed. Handwritten information may be generated from the instruction locus and registered in the output information memory M3.

  In the second embodiment described above, the mobile terminal device 300 is illustrated as an output target. However, for example, it is a mere object such as a touch screen or other display device, a magazine, a notebook, a figurine, a decoration, or a piece of paper. May be.

  In the second embodiment described above, the display device 200 is a touch screen, and when any object is placed, it is detected whether or not the mobile terminal device 300 is placed from the shape and size of the contact state. Or the actual position of the mobile terminal device 300 is detected, but it is detected whether the mobile terminal device 300 is placed by analyzing an image obtained by photographing the display device 200 or the like. The actual position of the terminal device 300 may be detected. Alternatively, a plurality of (for example, three or four) short-range communication units (for example, Bluetooth (registered trademark) communication unit, RF tag communication unit) are arranged at predetermined positions on a desk, and radio waves transmitted from an output object Is received by each communication unit, the information output control device acquires the received signal from each communication unit and detects the actual position of the output object from the radio field intensity and triangulation calculation. Also good.

  In each of the above-described embodiments, the case where the information output control device is applied to a projector device or a notebook PC has been described. However, the present invention is not limited to this, and for example, a PDA (personal portable information communication device), a tablet terminal device, It may be a mobile phone such as a smartphone or an electronic game.

  Further, the “apparatus” and “unit” shown in the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An information output control device that outputs information,
Input information acquisition means for acquiring input information;
A specifying means for specifying a predetermined output object placed in a predetermined area outside the control device;
Information storage means for storing the input information acquired by the input information acquisition means in association with the output object while the output object specified by the specification means actually exists in the predetermined area;
Output control means for reading out and reproducing the input information stored in association with the output object when the output object is placed again in the predetermined area;
It is characterized by providing.
(Claim 2)
The invention described in claim 2 is the information output control device according to claim 1,
The output control means performs a control to end the reproduction output when the specifying means cannot specify that the output object actually exists in the predetermined area.
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the information output control device according to claim 1 or 2,
A determination means for determining in which direction or position the input information acquired by the input information acquisition means is input with reference to the output object in the predetermined area;
The information storage means stores the result determined by the determination means in association with the output object as information indicating the input source,
The output control means determines the direction or position for the reproduction output based on the information indicating the input source, and performs the reproduction output using the determined direction or position as the output destination.
It is characterized by that.
(Claim 4)
The invention according to claim 4 is the information output control device according to claim 3,
When the output control means determines the output destination based on the information indicating the input source, the same direction or position, the opposite direction or position, the arbitrarily set direction or position with respect to the input direction or position One of the output destinations,
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the information output control device according to claim 1 or 2,
A position acquisition means for acquiring an actual position of the output object in the predetermined area;
The output control means determines the position to be reproduced based on the actual position of the output object acquired by the position acquisition means, and performs reproduction output at the determined output position.
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the information output control device according to any one of claims 1 to 5,
An identification information generating means for generating identification information for identifying the output object;
The information storage means stores the identification information generated by the identification information generation means in association with the information input by the input means,
The specifying means specifies the identification information from the output object existing in the predetermined area,
The output control means reads out the information associated with the identification information specified by the specifying means from the display information storage means and reproduces and outputs the information;
It is characterized by that.
(Claim 7)
The invention described in claim 7
A program for controlling a computer of an information output control device for outputting information,
The computer,
An input means for inputting the information;
A specifying means for specifying a predetermined output object placed in a predetermined area outside the control device;
Information storage means for storing the information input by the input means while the output object specified by the specifying means is actually present in the predetermined area;
Output control means for reading out and reproducing the input information stored in association with the output object when the output object is placed again in the predetermined area;
Program to function as.

1 Information output control device (projector device)
2 Electronic paper 3 Projectable area 5 Microphone 6 Speaker 11, 101 CPU
DESCRIPTION OF SYMBOLS 12, 102 Memory | storage part 16 Camera part 17 Projector part M1 Program memory M3 Display information memory 100 Information output control apparatus (notebook type PC)
107 short-range communication unit 200 display device 300 portable terminal device

Claims (7)

An information output control device that outputs information,
Input information acquisition means for acquiring input information;
A specifying means for specifying a predetermined output object placed in a predetermined area outside the control device;
Information storage means for storing the input information acquired by the input information acquisition means in association with the output object while the output object specified by the specification means actually exists in the predetermined area;
Output control means for reading out and reproducing the input information stored in association with the output object when the output object is placed again in the predetermined area;
An information output control device comprising: The output control means performs a control to end the reproduction output when the specifying means cannot specify that the output object actually exists in the predetermined area.
The information output control device according to claim 1. A determination means for determining in which direction or position the input information acquired by the input information acquisition means is input with reference to the output object in the predetermined area;
The information storage means stores the result determined by the determination means in association with the output object as information indicating the input source,
The output control means determines the direction or position for the reproduction output based on the information indicating the input source, and performs the reproduction output using the determined direction or position as the output destination.
The information output control device according to claim 1, wherein the information output control device is an information output control device. When the output control means determines the output destination based on the information indicating the input source, the same direction or position, the opposite direction or position, the arbitrarily set direction or position with respect to the input direction or position One of the output destinations,
The information output control apparatus according to claim 3. A position acquisition means for acquiring an actual position of the output object in the predetermined area;
The output control means determines the position to be reproduced based on the actual position of the output object acquired by the position acquisition means, and performs reproduction output at the determined output position.
The information output control device according to claim 1, wherein the information output control device is an information output control device. An identification information generating means for generating identification information for identifying the output object;
The information storage means stores the identification information generated by the identification information generation means in association with the information input by the input means,
The specifying means specifies the identification information from the output object existing in the predetermined area,
The output control means reads out the information associated with the identification information specified by the specifying means from the display information storage means and reproduces and outputs the information;
The information output control device according to claim 1, wherein the information output control device is an information output control device. A program for controlling a computer of an information output control device for outputting information,
The computer,
An input means for inputting the information;
A specifying means for specifying a predetermined output object placed in a predetermined area outside the control device;
Information storage means for storing the information input by the input means while the output object specified by the specifying means is actually present in the predetermined area;
Output control means for reading out and reproducing the input information stored in association with the output object when the output object is placed again in the predetermined area;
Program to function as.

Images