JP2002358063A - Display control system, display service providing system, display device, and program for display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display control system which easily gives a highlight effect according with presentation contents of a presenter and is suitable for flexible and smooth presentation. SOLUTION: A portable terminal 140 and a projector 200 are so connected that they can communicate with each other. When presenter's operation is inputted, the portable terminal 140 transmits inputted operation contents to the projector 200. When projector display data including highlight designation information related to contents of the highlight effect to be given in a display picture is given, the projector 200 controls projection of presentation on the basis of projector display data. When operation contents are received in the middle of projection control, the projector detects operation contents related to the highlight effect out of received operation contents as highlight operation information based on highlight designation information included in projector display data to give the highlight effect in the display picture based on detected highlight operation information while controlling projection of presentation in accordance with received operation contents.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device such as a projector and a portable terminal, each of which is associated with a virtual object, places each virtual object in a virtual space corresponding to a real space, and sets a positional relationship between the virtual objects. The present invention relates to systems, terminals, devices and programs that provide display services based on display devices based on the technology. In particular, it is easy to give an emphasis effect according to the content of the presenter's presentation, and to make a flexible and smooth presentation. The present invention relates to a display control system, a display service providing system, a display device, and a display device program that are suitable for the present invention.

[0002]

2. Description of the Related Art Conventionally, as a projector for projecting an image on a screen, for example, there has been a presentation device disclosed in Japanese Patent Application Laid-Open No. 7-167896. This generates a speech recognition unit that recognizes a keyword included in speech input from the microphone with reference to a microphone and a speech recognition dictionary used for speech recognition, and generates an operation command corresponding to the recognized keyword. A command generation unit, a presentation storage unit storing projector display data such as images and sounds used for presentation, a presentation operation unit operating the stored projector display data based on the operation command, and A presentation output unit for outputting projector display data.

[0003] This makes it possible to recognize a keyword included in the voice input to the microphone and to automatically operate presentation data such as images and voices based on the recognized keyword.

[0004]

In the present presentation environment, when presenters create projector display data as presentation materials, the presenter specifies, in the display screen, a part of the presentation that the user wants to emphasize. Emphasis effects such as enlarging images and characters may be included. By doing so, the presenter can operate an operation unit such as a projector, for example, while performing an explanation while displaying a certain display screen, so that a specific image or character is enlarged in the display screen. Can be given an emphasis effect. By giving a related explanation in conjunction with this, it becomes easier to convey the presentation point of the presenter to the viewer.

However, since such a highlighting effect needs to be set in advance in the projector display data by designating a portion desired to be emphasized, the presenter forgets the portion to be emphasized during the presentation. If this happens, an emphasis effect will be given that does not conform to the presenter's announcement,
On the contrary, there is a possibility that it will be difficult to convey the announcement point to the viewer. In some cases, the presenter may want to change the content of the presentation at the time of the presentation depending on the reaction of the viewer, but it is extremely difficult to make a significant change because the emphasized portion is specified.

Therefore, it is not only difficult to give an emphasis effect in accordance with the content of the presenter's presentation, but also unsuitable for making a flexible and smooth presentation. On the other hand, in the projector device described above, operability is improved in that a voice operation can be realized, but the above-described problem relating to the emphasis effect still exists.

Therefore, the present invention has been made in view of such unresolved problems of the prior art, and it is easy to give an emphasis effect in accordance with the contents of presentation by the presenter. It is an object of the present invention to provide a display control system, a display service providing system, a display device, and a display device program suitable for making a flexible and smooth presentation.

[0008]

According to a first aspect of the present invention, there is provided a display control system according to the present invention.
When display data including emphasis designation information relating to the content of an emphasis effect to be given in a display screen is given, a display is performed based on the given display data, and the emphasis effect is given in the display screen. And display means, operation state detection means for detecting an operation state of a user, and display control means for performing display control for displaying a screen on the display means based on the display data, wherein the display control means comprises: When the display data is given, while performing the display control based on the given display data,
An emphasis effect is given in the display screen based on the emphasis designation information included in the given display data and the operation state detected by the operation state detection means.

With such a configuration, the operating state of the user is detected by the operating state detecting means. Then, when the display data is provided, the display control means performs display control based on the provided display data, and displays based on the emphasis designation information included in the provided display data and the detected operation state. An emphasis effect is given in the screen.

Here, the operating state detecting means may be of any configuration as long as it detects the operating state of the user. Alternatively, a voice input unit for inputting voice as data and a voice recognition unit for performing voice recognition based on voice data input by the voice input unit are included. Further, the present system may be realized as a single device, or may be realized as a network system in which a plurality of terminals are communicably connected. In the latter case, the constituent elements may belong to any of the plurality of terminals as long as they are communicably connected.

Further, in the display control system according to a second aspect of the present invention, the portable terminal used by the user and the display device are communicably connected to each other, and the emphasis on the content of the emphasis effect given on the display screen is provided. When display data including designation information is given, a system that performs display based on the given display data and gives an emphasis effect in the display screen, wherein the mobile terminal performs an operation by the user. It has an operation input means for inputting, and is configured to transmit the operation content input by the operation input means to the display device, the display device is a display means, the display means based on the display data in the display means Display control means for performing display control for displaying a screen, the display control means,
When the display data is provided, the display control is performed based on the provided display data. When the operation content is received during the display control, the display control is performed according to the received operation content. On the other hand, based on the emphasis designating information included in the given display data, the received operation content related to the emphasis effect is detected as emphasis operation information, and based on the detected emphasis operation information, Gives an emphasis effect.

With such a configuration, in the display device,
When display data is provided, display control is performed by the display control means based on the provided display data. In the mobile terminal, when an operation by the user is input from the operation input unit during the display control, the input operation content is transmitted to the display device. In the display device, when the operation content is received during the display control, the display control unit performs the display control in accordance with the received operation content, while receiving the operation content based on the emphasis designation information included in the given display data. The operation content related to the emphasis effect is detected as emphasis operation information, and the emphasis effect is given in the display screen based on the detected emphasis operation information.

Further, in the display control system according to a third aspect of the present invention, in the display control system according to the second aspect, the portable terminal may change the strength of the operation input by the operation input means into the operation content. The display control means, when receiving the operation content, changes the degree of the emphasis effect according to the strength of the operation included in the received operation content. It has become.

With such a configuration, in the portable terminal,
The strength of the input operation is included in the operation content and transmitted to the display device. In the display device, when the operation content is received during the display control, the display control means changes the degree of the emphasis effect according to the strength of the operation included in the received operation content.
Further, the display control system according to claim 4 of the present invention connects the portable terminal to be used by the user and the display device so as to be able to communicate with each other, and outputs the emphasis designation information on the content of the emphasis effect to be given on the display screen. A system which, when given display data is provided, performs display based on the given display data and gives an emphasis effect in the display screen, wherein the portable terminal is configured to input voice as data. Means, the audio data input by the audio input means is to be transmitted to the display device,
The display device includes a display unit, a display control unit that performs display control for displaying a screen on the display unit based on the display data, and a voice recognition unit that performs voice recognition based on the received voice data. And when the display data is given, the display control means performs the display control based on the given display data, and on the basis of the emphasis designation information included in the given display data, Among the recognition results obtained by the recognition means, the one related to the emphasis effect is detected as emphasis sound information, and the emphasis effect is applied in the display screen based on the detected emphasis sound information.

With this configuration, in the display device,
When display data is provided, display control is performed by the display control means based on the provided display data. In the mobile terminal, when a user's utterance is input from the voice input unit during display control, the input voice data is transmitted to the display device. In the display device, when voice data is received during display control, voice recognition is performed by voice recognition means based on the received voice data, and based on the emphasis designation information included in the given display data by the display control means. Then, the result of the voice recognition relating to the emphasis effect is detected as the emphasis sound information, and the emphasis effect is given in the display screen based on the detected emphasis sound information.

According to a fifth aspect of the present invention, in the display control system according to the fourth aspect, when the display control means receives the audio data, the display control means reproduces the received audio data. The degree of the emphasis effect is changed according to the strength of the voice to be played. With this configuration, when the display device receives the audio data, the display control unit changes the degree of the enhancement effect according to the strength of the audio reproduced by the received audio data.

Further, in the display control system according to a sixth aspect of the present invention, in the display control system according to the fifth aspect, the voice recognition means holds a keyword relating to a degree of an emphasis effect, and outputs a sound of the voice data. The degree of the emphasis effect is changed depending on the presence or absence of the keyword regarding the degree of the emphasis effect in addition to the strength of the emphasis.
With such a configuration, the degree of the emphasis effect changes according to the strength of the reproduced sound and the keyword for determining the emphasis level.

Further, a display control system according to a seventh aspect of the present invention is the display control system according to any one of the second to sixth aspects, wherein the display device is a projection display device. With such a configuration, in the projection display device, when display data is provided, the display control means performs display control by projection based on the provided display data.

On the other hand, in order to achieve the above object, a display service providing system according to claim 8 of the present invention connects a portable terminal to be used by a user and a display device so as to communicate with each other, and provides a first virtual system. While associating an object with the display device and associating a second virtual object with the mobile terminal, arranging the first virtual object on a virtual space corresponding to a real space and positioning the mobile terminal in the virtual space or its position A system that arranges the second virtual object in the vicinity and provides a display service related to display of a display device corresponding to the first virtual object based on a positional relationship between the first virtual object and the second virtual object. And displaying the first object information relating to the shape and arrangement position of the first virtual object. First for storing in association with vessel
Storage means, second storage means for storing second object information relating to the shape and arrangement position of the second virtual object in association with the portable terminal, and emphasis designation relating to the content of the emphasis effect given in the display screen Display data storage means for storing display data including information in association with the mobile terminal, and position information obtaining means for obtaining position information for specifying the position of the mobile terminal, Updating the second object information in the second storage means based on the position information acquired by the means,
An area specified by a shape and an arrangement position of the first virtual object based on the first object information of the first storage means and the second object information of the second storage means; When it is determined that the area specified by the arrangement position overlaps, the display data stored in the display data storage means corresponding to the portable terminal corresponding to the second virtual object is replaced with the first virtual object. The portable terminal has an operation input unit for inputting an operation by the user, and transmits the operation content input by the operation input unit to the display device. Wherein the display device is a display means,
Display control means for performing display control for displaying a screen on the display means based on the display data, wherein the display control means, when receiving the display data, displays the display based on the received display data. Performing the control, when the operation content is received during the display control, while performing the display control according to the received operation content, based on the emphasis designation information included in the received display data, the received The operation contents related to the emphasis effect are detected as emphasis operation information, and the emphasis effect is applied in the display screen based on the detected emphasis operation information.

With this configuration, the position information is obtained by the position information obtaining means, and the second object information in the second storage means is updated based on the obtained position information. Then, based on the first object information in the first storage means and the second object information in the second storage means,
It is determined whether an area specified by the shape and the position of the first virtual object overlaps an area specified by the shape and the position of the second virtual object. That is, when the mobile terminal approaches the area of the first virtual object or its vicinity, it is determined that those areas overlap. When the overlap is determined, the display data stored in the display data storage unit corresponding to the mobile terminal corresponding to the second virtual object is transmitted to the display device corresponding to the first virtual object.

When the display device receives the display data,
The display control unit performs display control based on the received display data. In the mobile terminal, when an operation by the user is input from the operation input unit during the display control, the input operation content is transmitted to the display device. In the display device, when receiving the operation content during the display control, the display control means,
While the display control is performed according to the received operation content, based on the emphasis designation information included in the received display data,
Among the received operation contents, those related to the emphasis effect are detected as emphasis operation information, and the emphasis effect is given in the display screen based on the detected emphasis operation information.

Here, the virtual object has a logical shape and an arrangement position in the virtual space corresponding to the real space. The shape is, for example, a radius of 1 [m around the arrangement position. ], May be a cube having a side of about 1 [m] centered on the arrangement position, and may include any shape such as a shape replicating a natural object or a living thing. The shape is not limited to a three-dimensional shape, and may be a two-dimensional shape. This relatively clarifies the area in which the display service is provided.
It is possible to provide different display services in small units such as units, and since the area where the display service is provided and the area associated with the mobile terminal have a predetermined range instead of a point, the user can display Service will be easier. Hereinafter, the same applies to the display service providing system according to the ninth aspect.

Transmission of display data means transmission of display data directly or indirectly. In the case of indirect transmission, for example, it is communicably connected to an external terminal capable of transmitting display data. Then, the present system requests the external terminal to transmit display data, and the external terminal transmits the display data triggered by the transmission request.
That is, transmission of the display data can be performed in cooperation with the present system and one or more external terminals. Hereinafter, the same applies to the display service providing system according to the ninth aspect.

The first storage means stores the first object information by any means and at any time, and may store the first object information in advance, or may store the first object information in advance. Instead of storing the information in advance, the first object information may be stored by an external input or the like during the operation of the present system. The same applies to the case where the second object information is stored in the second storage means and the case where the display data is stored in the display data storage means. Hereinafter, the same applies to the display service providing system according to the ninth aspect.

Further, the position information acquiring means may acquire the position information by measuring the position of the portable terminal with a communication terminal to which the portable terminal is communicably connected, for example. The position information may be obtained by measuring the position of the mobile terminal using a positioning system or the like, or by calculating the position of the communication terminal based on the measurement information from the mobile terminal. Then, the position information is obtained by measuring the position of the mobile terminal at the base station to which the mobile terminal is connected, or by calculating the position at the communication terminal based on the measurement information from the base station. Is also good. Hereinafter, the same applies to the display service providing system according to the ninth aspect.

Further, in the display service providing system according to the ninth aspect of the present invention, the portable terminal for use by the user is communicably connected to the display device, and the first virtual object is associated with the display device. And associating a second virtual object with the portable terminal, arranging the first virtual object on a virtual space corresponding to a real space, and placing the second virtual object at or near the position of the portable terminal in the virtual space. A system for arranging and providing a display service related to display of a display device corresponding to the first virtual object based on a positional relationship between the first virtual object and the second virtual object; The first object information relating to the shape and arrangement position of the display device is stored in association with the display device. First storage means, second storage means for storing second object information relating to the shape and arrangement position of the second virtual object in association with the portable terminal, and an emphasis effect given in the display screen. Display data storage means for storing display data including emphasis designation information related to the content in association with the portable terminal;
Position information acquisition means for acquiring position information for specifying the position of the portable terminal, and updating the second object information in the second storage means based on the position information acquired by the position information acquisition means; An area specified by a shape and an arrangement position of the first virtual object based on the first object information of the first storage means and the second object information of the second storage means; When it is determined that the area specified by the arrangement position overlaps, the display data stored in the display data storage means corresponding to the portable terminal corresponding to the second virtual object is replaced with the first virtual object. The portable terminal has a voice input means for inputting voice as data, The audio data input by the voice input means is transmitted to the display device, and the display device performs display control for displaying a screen on the display means based on the display data. Control means, and voice recognition means for performing voice recognition based on the received voice data, wherein the display control means, when receiving the display data, performs the display control based on the received display data On the other hand, based on the emphasis designation information included in the received display data, a recognition result of the speech recognition means that detects an emphasis effect is detected as emphasized speech information, and the display screen is displayed based on the detected emphasized speech information. It has an emphasis effect in it.

With such a configuration, the position information is obtained by the position information obtaining means, and the second object information in the second storage means is updated based on the obtained position information. Then, based on the first object information in the first storage means and the second object information in the second storage means,
It is determined whether an area specified by the shape and the position of the first virtual object overlaps an area specified by the shape and the position of the second virtual object. That is, when the mobile terminal approaches the area of the first virtual object or its vicinity, it is determined that those areas overlap. When the overlap is determined, the display data stored in the display data storage unit corresponding to the mobile terminal corresponding to the second virtual object is transmitted to the display device corresponding to the first virtual object.

When the display device receives the display data,
The display control unit performs display control based on the received display data. In the mobile terminal, when a user's utterance is input from the voice input unit during display control, the input voice data is transmitted to the display device. In the display device, when receiving the voice data during the display control, the voice recognition unit performs voice recognition based on the received voice data,
The display control means detects, based on the emphasis designation information included in the received display data, a speech recognition result related to the emphasis effect as emphasized speech information, and displays the result on the display screen based on the detected emphasized speech information. Gives an emphasis effect.

On the other hand, in order to achieve the above object, a display device according to a tenth aspect of the present invention is a device communicably connected to a portable terminal in the display control system according to the second aspect. And display control means for performing display control for displaying a screen on the display means based on the display data, wherein the display control means, when the display data is given, based on the given display data Performing the display control, when the operation content is received during the display control, while performing the display control according to the received operation content, based on the emphasis designation information included in the given display data Detecting, as the emphasis operation information, the one related to the emphasis effect among the received operation contents, and applying the emphasis effect in the display screen based on the detected emphasis operation information. You have me.

With such a configuration, an operation equivalent to that of the display device in the display control system according to the second aspect can be obtained. Further, a display device according to claim 11 of the present invention is a device that is communicably connected to a portable terminal in the display control system according to claim 4, wherein the display device includes a display device and the display device based on the display data. Display control means for performing display control to display a screen, and voice recognition means for performing voice recognition based on the received voice data, the display control means, when the display data is given, given While performing the display control based on the display data
Based on the emphasis designation information included in the given display data, a recognition result of the speech recognition unit related to an emphasis effect is detected as emphasized speech information, and the display screen is displayed based on the detected emphasized speech information. It has an emphasis effect.

With such a configuration, an operation equivalent to that of the display device in the display control system according to the fourth aspect can be obtained. On the other hand, to achieve the above object, a display device program according to a twelfth aspect of the present invention is a program for causing a display device according to the tenth aspect to be executed by a computer, and is provided based on the display data. Is a program for executing processing realized as display control means for performing display control for displaying a screen on the display means, wherein the display control means, when the display data is given, a given display. Performing the display control based on the data, and when receiving the operation content during the display control, performing the display control according to the received operation content, while emphasizing designation information included in the given display data. Based on the received operation content, the one related to the emphasis effect is detected as emphasis operation information, and the table is displayed based on the detected emphasis operation information. It adapted to provide an enhanced effect among the screen.

With such a configuration, when the program is read by the display device and the display device executes processing in accordance with the read program, an operation equivalent to that of the display device according to the tenth aspect is obtained. Further, a display device program according to a thirteenth aspect of the present invention is a program for causing a display device according to the eleventh aspect to be executed by a computer, and displays a screen on the display means based on the display data. A program implemented by a display control unit that performs display control. The display control unit, when given the display data, performs the display control based on the given display data. On the other hand, based on the emphasis designation information included in the given display data, among the recognition results obtained by the speech recognition means, those related to the emphasis effect are detected as emphasized speech information, and based on the detected emphasized speech information, The emphasis effect is given in the display screen.

With such a configuration, when the program is read by the display device and the display device executes processing in accordance with the read program, an operation equivalent to that of the display device according to the eleventh aspect is obtained.

[0034]

Embodiments of the present invention will be described below with reference to the drawings. 1 to 15 show a display control system, a display service providing system,
It is a figure which shows embodiment of a display apparatus and a program for display apparatuses. In the present embodiment, as shown in FIG. 1, a display control system, a display service providing system, a display device, and a display device program according to the present invention are used in a presentation hall where a presentation is performed.
A virtual object A having a spherical shape is placed and set in a region surrounding the portable terminal 140 for use by the presenter. When the virtual objects A and B overlap, the portable terminal 140 is placed. This is applied to a case in which a projection service by the projector 200 is started based on the projector display data of FIG.

First, the configuration of a network system to which the present invention is applied will be described with reference to FIG. FIG. 1 is a diagram showing a configuration of a network system to which the present invention is applied. In FIG. 1, a virtual object management device 100 for managing virtual objects is provided on a wall in a presentation hall.
And a service cooperation management device 240 that manages the cooperation of services between the devices.

In the presentation hall, a projector 200 used for presentation and a printer 220 used for printing presentation materials are installed.
PDA (Personal Digital Assis) for use by presenters
tant). Note that the portable terminal 140 stores projector display data to be projected by the projector 200 as presentation material, and the projector display data is a portion of the display screen to which an emphasis effect is applied and emphasis designation information indicating the content thereof. It is comprised including. Thus, if the presenter desires to give an emphasis effect during the presentation, the presenter can designate and set in advance the location and the content to be emphasized in the projector display data. For example, on the third page of the projector display data, it is possible to specify an emphasis effect such that, when the upper right of the display screen is instructed, the characters arranged there are enlarged.

Further, the virtual object management device 100,
Mobile terminal 140, projector 200, printer 220
The service cooperation management device 240 can communicate with each other by wireless communication. Specifically, the virtual object management device 100 communicates with the mobile terminal 140, the projector 200, the printer 220, and the service cooperation management device 240, and the mobile terminal 140 communicates with the virtual object management device 100, the projector 200, the printer 220, and the service. The projector 200 and the printer 220 communicate with the cooperation management device 240.
It communicates with the virtual object management device 100, the mobile terminal 140, and the service cooperation management device 240.

On the other hand, in the area surrounding the projector 200, a virtual object A having a spherical shape is
A virtual object B having a spherical shape is set in a region surrounding 40, and a virtual object C having a spherical shape is set in a region surrounding the printer 220. These virtual objects are stored in the virtual object management device 100.
It is a logical area managed by.

The service cooperation management device 240 has a storage device for storing communication object data for establishing communication with the portable terminal 140, the projector 200, and the printer 220, and in response to a request from each device. The communication object data is read from the storage device and transmitted. The storage device includes communication object data A for establishing communication with the projector 200, communication object data B for establishing communication with the portable terminal 140, and the printer 22.
The communication object data C for establishing communication with 0 is stored. For example, the mobile terminal 140
Communicates with the projector 200 via the mobile terminal 14.
0 is obtained by acquiring the communication object data A from the service cooperation management device 240 and executing a communication establishment process based on the acquired communication object data A.
Communication with the projector 200 is established. That is, the communication object data A to C have a function as a driver for establishing communication with a specific partner.

Next, the configuration of the virtual object management device 100 will be described in detail with reference to FIG. FIG. 2 is a block diagram showing a configuration of the virtual object management device 100. As shown in FIG. 2, the virtual object management apparatus 100 includes a CPU 30 for controlling the calculation and the entire system based on the control program, and a ROM 3 for storing a control program for the CPU 30 in a predetermined area in advance.
2 and data read from the ROM 32 or the CPU 30
RAM 3 for storing the operation results required in the operation process
4 and an I / O for mediating data input / output to / from an external device.
And F38, which are mutually connected by a bus 39 which is a signal line for transferring data so as to be able to exchange data.

The I / F 38 registers and manages, as external devices, a wireless communication device 40 that performs wireless communication with the portable terminal 140, the projector 200, the printer 220, and the service cooperation management device 240, and object information on virtual objects. A virtual object management database (hereinafter, simply abbreviated as DB) 42 and a display device 44 that displays a screen based on an image signal are connected.

FIG. 3 shows the virtual object management DB 42.
As shown in FIG. 5, a virtual object management table 400 is stored in which object information relating to the shape and arrangement position of a virtual object can be registered in association with service information that defines service contents. FIG. 3 is a diagram showing a data structure of the virtual object management table 400.

The virtual object management table 400 includes:
As shown in FIG. 3, one record can be registered for each virtual object. Each record includes a field 402 for registering a serial number and a projector 200.
A field 404 for registering a type of service using a device such as a device, a field 406 for registering a service ID for specifying a service, and coordinates indicating the arrangement position of the virtual object in the virtual space corresponding to the real space. A field 408 for registering, a field 410 for registering the shape of the virtual object, a field 412 for registering the size of the virtual object, and a field 414 for registering area-in management information for managing cooperation between services are included. It is composed of Here, the data in the fields 404 and 406 correspond to the service information, and the data in the fields 408 to 412 correspond to the object information.

In the example of FIG. 3, in the first record in the figure, the field 402 has "1" as the serial number, the field 404 has the service type "Projector Service", and the field 406 has the service ID " 00
01 ”becomes“ (10,50,20) ”in the field 408 as coordinates.
In the field 410, “sphere” is registered as the shape, and in the field 412, “2 [m]” is registered as the size. This means that the radius is 2 [m] around the coordinates (10, 50, 20) in the real space where the projector 200 is installed.
Means that the virtual object A having the spherical shape is virtually arranged, and the projection service by the projector 200 is performed in the internal area of the virtual object A specified by the arrangement position and the shape.

In the second row of the record, “2” is stored in the field 402 as a serial number,
04, "PDA service" as a service type, "0002" as a service ID in a field 406, "(30, 40, 20)" as a coordinate in a field 408, "sphere" as a shape in a field 410, and a field 412 "1 [m]" is registered as the size. This is the coordinates of the real space where the mobile terminal 140 is located (30, 4
A virtual object B having a spherical shape with a radius of 1 [m] centered at (0, 20) is virtually arranged, and in the internal area of the virtual object B specified by the arrangement position and shape, the mobile terminal 140 Means that the service is performed. However, since the coordinates of the real space where the mobile terminal 140 exists change every moment, the PD
For the service A, position information from the mobile terminal 140 is obtained, and the coordinates of the field 408 are updated based on the position information. For example, when the area of the virtual object A and the area of the virtual object B overlap, the projector service and the PDA service cooperate, and the projector 200 and the portable terminal 140 can use each other.

As shown in FIG. 4, the virtual object management DB 42 includes, for each service, communication information for specifying communication object data to be acquired from the service cooperation management device 240 when using the service. Is stored in the communication information registration table 500. FIG. 4 is a diagram showing a data structure of the communication information registration table 500.

As shown in FIG. 4, one record is registered in the communication information registration table 500 for each service. Each record has a field 502 in which a service ID is registered and a field 50 in which a service type is registered.
4 and a field 506 in which communication information is registered. The communication information registration table 500
Are stored not only in the virtual object management device 100 but also in the storage devices of the portable terminal 140, the projector 200, the printer 220, and the service cooperation management device 240.

In the example shown in FIG. 4, the first record in the figure contains a service ID "0001" in the field 502.
In the field 504, “projector service” is registered as a service type, and in the field 506, “communication object data A” is registered as communication information. This means that the communication object data to be acquired from the service cooperation management device 240 when using the projector service is the communication object data A.

The CPU 30 comprises a microprocessing unit MPU and the like, activates a predetermined program stored in a predetermined area of the ROM 32, and executes the object information updating process shown in the flowcharts of FIGS. The notification processing and the area-out notification processing are executed in a time-division manner.

First, the object information updating process is shown in FIG.
This will be described in detail with reference to FIG. FIG. 5 is a flowchart showing the object information updating process. The object information updating process is a process of updating the arrangement position of the virtual object B based on the position information from the portable terminal 140. When executed by the CPU 30, the process first proceeds to step S404 as shown in FIG. It is supposed to.

In step S404, it is determined whether or not the position information has been received.
If (Yes), the process proceeds to step S406. If not (No), the process waits in step S404 until position information is received. In step S406, the coordinates of the field 408 of the virtual object management table 400 are updated for the PDA service based on the received position information, and the process proceeds to step S408, where a response to the reception of the position information is sent to the portable terminal 140. Then, a series of processes is completed and the process returns to the original process.

Next, the area-in notification processing will be described in detail with reference to FIG. FIG. 6 is a flowchart showing the area-in notification processing. Area-in notification processing is 2
This is a process of notifying each device that the area of one virtual object and the area of the other virtual object overlap with each other for one virtual object. When the processing is executed by the CPU 30, as shown in FIG. The process proceeds to S500.

In step S500, a record of the PDA service (hereinafter, referred to as object information and service information of portable terminal 140 in this process) is read from virtual object management table 400, and is read.
The process moves to step S502, where the first record (hereinafter, referred to as object information and service information of the target device in this process) is read from the virtual object management table 400, and the process moves to step S504.

In step S504, based on the object information of the portable terminal 140 and the object information of the target device, an area specified by the shape and the position of the virtual object B, and the shape and the position of the virtual object corresponding to the target device Then, it is determined whether or not the area specified by overlaps. If it is determined that these areas overlap (hereinafter, referred to as area-in) (Yes), the process proceeds to step S554.

In step S554, an e-mail indicating that the operation right of the target device can be set is created.
The process proceeds to 556, and attaches the email address of the virtual object management device 100 to the created email,
In step S558, the communication information of the PDA service is read from the communication information registration table 500, and the communication object data B is acquired from the service cooperation management device 240 based on the read communication information. Next, the process shifts to step S560 to execute communication establishment processing based on the acquired communication object data B, thereby establishing communication with the portable terminal 140, and step S55.
4. The e-mail created in S556 is transmitted to the portable terminal 140 by a communication method in an e-mail format, and step S
The process moves to 562.

In step S562, step S560
It is determined whether a response e-mail has been received for the e-mail sent in step 2.
es), the process moves to step S564, the operation right of the target device is set, and the process moves to step S506. On the other hand, if it is determined in step S562 that the response mail has not been received (No), the process proceeds to step S562 until the response mail is received.
Wait at.

In step S506, the communication information is read from the communication information registration table 500 based on the service information of the target device, and the communication object data of the corresponding service is obtained from the service cooperation management device 240 based on the read communication information. Proceeding to step S508,
Establish communication with the target device by executing communication establishment processing based on the acquired communication object data,
The area in is notified to the target device, and the process proceeds to step S540.

In step S540, it is determined whether or not a response to the notification of the area-in has been received. If it is determined that the response has been received (Yes), the process proceeds to step S542. No), the process stands by in step S540 until a response is received. Step S542
Then, the service ID of the service is registered in the area-in management information of the PDA service, the process proceeds to step S544, and the process proceeds to steps S504 to S504 for all the services registered in the virtual object management table 400.
It is determined whether or not the processing of 542 has been completed, and when it is determined that the processing has been completed (Yes), a series of processing is completed and the processing returns to the original processing.

On the other hand, if it is determined in step S544 that the processes in steps S504 to S542 have not been completed for all services (No), the process proceeds to step S546, and the next record is read from the virtual object management table 400. The process proceeds to step S504.
On the other hand, when it is determined in step S504 that the area is not in (No), the process proceeds to step S544.

Next, the area out notification processing will be described in detail with reference to FIG. FIG. 7 is a flowchart showing the area out notification processing. The area-out notifying process is a process of notifying each device that the overlap between the area of one virtual object and the area of the other virtual object has been released for the two virtual objects. As shown in FIG. 7, first, the process proceeds to step S600.

In step S600, a record on the PDA service (hereinafter, referred to as object information and service information of portable terminal 140 in this process) is read from virtual object management table 400, and is read.
The process shifts to step S602 to read the first service ID from the area-in management information of the PDA service, and shifts to step S604 to record the service with the read service ID (hereinafter, the object information of the target device and the (Referred to as service information) from the virtual object management table 400, and the process proceeds to step S606.

In step S606, based on the object information of the portable terminal 140 and the object information of the target device, an area specified by the shape and the position of the virtual object B, and the shape and the position of the virtual object corresponding to the target device Then, it is determined whether or not the area specified by overlaps. If it is determined that the areas do not overlap (hereinafter, referred to as area out) (Yes), the process proceeds to step S608.

In step S608, the communication information is read from the communication information registration table 500 based on the service information of the target device, and the communication object data of the corresponding service is acquired from the service cooperation management device 240 based on the read communication information. Proceeding to step S610,
Establish communication with the target device by executing communication establishment processing based on the acquired communication object data,
The area out is notified to the target device, and the process proceeds to step S626.

In step S626, it is determined whether a response to the area-out notification has been received. If it is determined that a response has been received (Yes), the process proceeds to step S628. No), the process stands by in step S626 until a response is received. Step S62
At S8, the service ID of the service is deleted from the area-in management information of the PDA service, and the process proceeds to step S630 to execute step S604 for all services registered in the area-in management information of the PDA service.
It is determined whether or not the processing from S628 to S628 has been completed. If it is determined that the processing has been completed (Yes), a series of processing is completed and the processing returns to the original processing.

On the other hand, if it is determined in step S630 that the processing in steps S604 to S628 has not been completed for all services (No), the process shifts to step S632, and the next PDA service area-in management information The service ID is read, and the routine goes to Step S604. On the other hand, if it is determined in step S606 that the area is not out (No), the process proceeds to step S630.

Next, the configuration of the projector 200 will be described in detail with reference to FIG. FIG. 8 shows the projector 2
FIG. 2 is a block diagram showing a configuration of a 00. Projector 20
As shown in FIG. 8, a CPU 70 controls the arithmetic operation and the entire system based on the control program, a ROM 72 in which a control program of the CPU 70 is stored in a predetermined area in advance, data read from the ROM 72 or the like, and the CPU 70. And a I / F 78 that mediates the input and output of data to and from an external device.
The buses 79 are signal lines for transferring data, and are connected to each other so as to be able to exchange data.

The I / F 78 includes, as external devices, a wireless communication device 80 for performing wireless communication with the virtual object management device 100, the portable terminal 140, and the service cooperation management device 240, and a screen on the screen based on an image signal. A projection device 82 for projecting is connected. CPU
Reference numeral 70 denotes a microprocessing unit MPU or the like, which activates a predetermined program stored in a predetermined area of the ROM 72, and executes an area-in notification response process and an area-out notification response shown in the flowcharts of FIGS. The processing is executed in a time-division manner.

First, the area-in notification response process will be described in detail with reference to FIG. FIG. 9 is a flowchart showing the area-in notification response process. The area-in notification response process is a process corresponding to the area-in notification process in FIG. 6, and when executed in the CPU 70, first, as shown in FIG. 9, the process proceeds to step S510.

In step S510, it is determined whether or not an area-in notification has been received. If it is determined that an area-in notification has been received (Yes), the process proceeds to step S512. (No), the process stands by in step S510 until the notification of the area-in is received. In step S512, it is determined whether the service related to the received area-in notification is a PDA service. If it is determined that the service related to the area-in notification is a PDA service (Yes), the process proceeds to step S514. , The communication information of the PDA service is read from the communication information registration table 500, the communication object data B is obtained from the service cooperation management device 240 based on the read communication information, and the process proceeds to step S516 to obtain the obtained communication object data. By executing communication establishment processing based on B, communication with mobile terminal 140 is established, a service cooperation start request is transmitted to mobile terminal 140, and step S52 is performed.
Then, the process proceeds to step S534, where a request for transmitting the projector display data is transmitted to the portable terminal 140, and the process proceeds to step S534.
Note that the cooperation start request in step S516 and the transmission request in step S524 may be transmitted by an e-mail communication method.

In step S534, it is determined whether or not the projector display data has been received. If it is determined that the projector display data has been received (Yes), the process proceeds to step S5.
The process proceeds to 36, but if it is determined that the condition is not satisfied (No),
Step S53 until the projector display data is received
Wait at 4. In step S536, a projection process of performing projection by the projection device 82 based on the received projector display data is performed, and the process proceeds to step S538.
The virtual object management device 100 is notified of the response that the notification of the area-in has been received, and a series of processes is terminated to return to the original process.

On the other hand, if it is determined in step S512 that the service related to the received area-in notification is not a PDA service (No), the flow shifts to step S548 to store the communication information of the corresponding service from the communication information registration table 500. By reading out and acquiring communication object data of the corresponding service from the service cooperation management device 240 based on the read communication information, and proceeding to step S550 to execute a communication establishment process based on the acquired communication object data. The communication with the target device of the corresponding service is established, a service cooperation start request is transmitted to the target device of the corresponding service, the process proceeds to step S552, the process for performing the service cooperation is performed, and the process proceeds to step S538.

Next, the area-out notification response process will be described with reference to FIG.
This will be described in detail with reference to FIG. FIG. 10 is a flowchart showing the area-out notification response process. The area-out notification response process is a process corresponding to the area-out notification process of FIG. 7, and when executed by the CPU 70, first, as shown in FIG. 10, the process proceeds to step S612.

In step S612, it is determined whether or not an area-out notification has been received. If it is determined that an area-out notification has been received (Yes), the process proceeds to step S614. (No), the process stands by in step S612 until an area-out notification is received. In step S614, it is determined whether or not the service related to the received area-out notification is a PDA service. If it is determined that the service is a PDA service related to the area-out notification (Yes), the process proceeds to step S616. ,
The communication information of the PDA service is stored in the communication information registration table 50.
0, the communication object data B is acquired from the service cooperation management device 240 based on the read communication information, and the process proceeds to step S618 to execute the communication establishment process based on the acquired communication object data B. To establish a communication with the mobile terminal 140, transmit a service cooperation end request to the mobile terminal 140, shift to step S624, and transmit a response to the effect that an area-out notification has been received to the virtual object management apparatus 100,
A series of processes is terminated and the process returns to the original process.

On the other hand, if it is determined in step S614 that the service related to the received area-out notification is not a PDA service (No), the process proceeds to step S634,
The communication information of the corresponding service is stored in the communication information registration table 500.
From the service cooperation management device 240 based on the read communication information, and proceeds to step S636 to execute a communication establishment process based on the obtained communication object data. Thus, communication with the target device of the service is established, a service cooperation end request is transmitted to the target device of the service, and the process shifts to step S624.

Next, the projection processing in step S536 will be described in detail with reference to FIG. FIG. 11 is a flowchart showing the projection processing. The projection process is a process of controlling the projector 200 in accordance with the operation content of the mobile terminal 140. When the projection process is executed in step S536, the process first proceeds to step S700 as shown in FIG. I have.

In step S700, step S536
The emphasis designation information is acquired from the projector display data received in step S702, and the process proceeds to step S702 to
It is determined whether or not the operation content of the mobile terminal 14 is received.
If it is determined that the operation content at 0 has been received (Yes), the process proceeds to step S704. In step S704, based on the acquired emphasis designation information, a received operation content related to the emphasis effect is detected as emphasis operation information,
The process proceeds to step S706 to determine whether or not the corresponding emphasized operation information has been detected. If it is determined that the corresponding emphasized operation information has been detected (Yes), the process proceeds to step S708. As will be described in detail later, the operation content includes the strength of the operation on the portable terminal 140.

In step S708, the degree of the emphasis effect is determined according to the strength of the operation included in the detected emphasis operation information, and the flow shifts to step S710 to be determined in step S708 based on the detected emphasis operation information. In the display screen, an emphasis effect according to the degree of
The flow shifts to 712, where projection control for performing projection by the projection device 82 is performed according to the received operation content. More specifically, in step S712, for example, if the received operation content indicates that the presentation being projected is advanced by one page, the projection being projected is advanced by one page, and the received operation content returns the presentation by one page. If so, the presentation being projected is returned by one page.

Then, the flow shifts to step S714, where it is determined whether or not the projection processing is to be terminated. When it is determined that the projection processing is to be terminated (Yes), a series of processing is terminated to return to the original processing. However, if it is determined that it is not (No),
The process moves to step S702. Whether or not to end the projection processing is determined by, for example, the mobile terminal 140 or the projector 20.
It can be determined by an end operation at 0.

On the other hand, if it is determined in step S706 that the corresponding emphasized operation information is not detected (No), the process proceeds to step S706.
It moves to 712. On the other hand, when it is determined in step S702 that the operation content on the mobile terminal 140 is not received (No)
Shifts to step S714. Next, the printer 22
0 will be described in detail.

The printer 220 has almost the same functions as the projector 200,
The difference from 00 is that a printing device is provided instead of the projection device 82. The processes executed by the CPU of the printer 220 are all the same except that a printing process is performed instead of the projection process of step S536. Next, the configuration of the portable terminal 140 will be described in detail with reference to FIG. FIG. 12 is a block diagram illustrating a configuration of the portable terminal 140.

The portable terminal 140, as shown in FIG.
A CPU 90 for controlling the calculation and the entire system based on the control program;
ROM 92 storing a control program for the
It comprises a RAM 94 for storing data read from the M92 and the like and a calculation result required in the calculation process of the CPU 90, and an I / F 98 for mediating input / output of data to and from an external device. Are connected to each other via a bus 99 which is a signal line for transferring data.

The I / F 98 includes, as external devices, a wireless communication device 83 that performs wireless communication with the virtual object management device 100, the projector 200, the printer 220, and the service cooperation management device 240, and a plurality of keys as a human interface. A key panel 84 capable of inputting data, an LCD (Liquid Crystal Display) 85 for displaying a screen based on an image signal, and measuring the current position of the portable terminal 140 to obtain position information for specifying the position And a position information acquisition device 86 to be connected.

The position information acquisition device 86 receives a time signal from the orbiting satellite transmitting a time signal indicating the current time,
A so-called G that measures the position based on the time lag indicated by the time signals and the orbit of each orbiting satellite.
The position of the current position is measured using the PS, and the measured position of the current position is output as position information.

The CPU 90 comprises a microprocessing unit MPU and the like, starts a predetermined program stored in a predetermined area of the ROM 92, and executes position information notification processing shown in the flowcharts of FIGS. The processing and the projector display data transmission processing are each executed in a time-division manner.

First, the position information notification processing will be described in detail with reference to FIG. FIG. 13 is a flowchart showing the position information notification processing. The position information notification process is a process corresponding to the object information update process of FIG. 5, and when executed by the CPU 90, first, as shown in FIG. 13, the process proceeds to step S400.

In step S400, the position information is acquired from the position information acquisition device 86, and the process shifts to step S402 to store the acquired position information in the virtual object management device 10.
0, and the process moves to step S410. Step S
At 410, it is determined whether a response to the transmission of the position information has been received, and when it is determined that a response has been received (Yes).
Terminates the series of processing and returns to the original processing. If it is not determined (No), the processing waits in step S410 until a response is received.

Next, the service cooperation processing will be described in detail with reference to FIG. FIG. 14 is a flowchart showing the service cooperation processing. The service cooperation process is shown in FIG.
And processing corresponding to the area-in notification response processing and the area-out notification response processing of FIG.
When executed in, as shown in FIG. 14, the process first proceeds to step S518.

In step S518, it is determined whether a service cooperation start request has been received. If it is determined that a service cooperation start request has been received (Yes), step S520
Then, the communication information of the service corresponding to the received service cooperation start request is read from the communication information registration table 500, and the communication object data of the service is read based on the read communication information.
40, and proceeds to step S522 to execute communication establishment processing based on the obtained communication object data, thereby establishing communication with the target device of the service, and starting cooperation with the service. A series of processes is terminated and the process returns to the original process.

On the other hand, if it is determined in step S518 that the service cooperation start request has not been received (No), the process proceeds to step S620 to determine whether or not a service cooperation end request has been received. If it is determined that has been received (Yes), the process proceeds to step S622 to end the cooperation with the service corresponding to the received service cooperation end request, end a series of processing, and return to the original processing.

On the other hand, when it is determined in step S620 that the service cooperation end request has not been received (No), the process proceeds to step S518. Next, the projector display data transmission processing will be described in detail with reference to FIG. FIG.
9 is a flowchart showing a projector display data transmission process. FIG. 9 shows the projector display data transmission process.
Processing corresponding to the area-in notification response processing of
When executed in the PU 90, as shown in FIG.
First, the process proceeds to step S526.

In step S526, it is determined whether or not the service is currently linked. If it is determined that the service is linked (Yes), the process proceeds to step S528. If it is determined that the service is not linked (No). Waits in step S526. In step S528, it is determined whether a transmission request for the projector display data has been received. If it is determined that the transmission request has been received (Yes), the process proceeds to step S530 to read the projector display data from the RAM 94 or the like. In step S532, the read projector display data is transmitted to the target device of the service, and a series of processes is completed to return to the original process.

On the other hand, when it is determined in step S528 that the request for transmitting the projector display data is not received (No)
Proceeds to step S566, determines whether or not an operation has been input from the key panel 84. If it is determined that an operation has been input from the key panel 84 (Yes), the process proceeds to step S56.
Then, the process proceeds to step S8, where the operation content including the operation intensity input on the key panel 84 is transmitted to the target device of the service, and a series of processes is completed to return to the original process.

On the other hand, in step S566, the key panel 8
If it is determined that no operation is input from No. 4 (No), the process proceeds to step S528. Next, the operation of the above embodiment will be described. In order for a presenter to make a presentation, first, projector display data for making a presentation is created, a portion on the display screen to which an emphasis effect is applied, and its contents are set and stored in the portable terminal 140. As the setting of the emphasis effect, for example, when a graph is displayed on a predetermined page of the projector display data, the X axis is blinked when the X axis is designated, and the Y axis is designated when the Y axis is designated. Set an emphasis effect whose content is to blink. Hereinafter, description will be made with reference to this setting example.

Next, after storing the projector display data, the presenter carries the portable terminal 140 and moves within the presentation hall.
Through 0 and S402, position information is acquired from the position information acquisition device 86, and the acquired position information is transmitted to the virtual object management device 100. Upon receiving the position information, the virtual object management device 100 proceeds to step S40.
6, S408, based on the received position information,
Virtual Object Management Table 4 for DA Service
The coordinates of the field 408 of 00 are updated, and a response that the position information has been received is sent to the portable terminal 140.

Upon receiving the response to the transmission of the position information, the portable terminal 140 waits for a predetermined time (for example, about 3 seconds).
, The transmission of the position information is repeatedly performed. Thereby, the arrangement position of the virtual object B is updated as the mobile terminal 140 moves. Next, when the presenter gives a presentation, the portable terminal 140 is made to approach the projector 200 with the virtual objects A to C set. As a result, when the virtual object B enters the virtual object A, the virtual object management device 100 executes steps S500 to S504 and S55.
Through steps S4 and S556, an e-mail indicating that the operation right of the projector 200 can be set is created, and the e-mail address of the virtual object management device 100 is attached to the created e-mail. Next, step S558
, The communication information of the PDA service is read from the communication information registration table 500, and the communication object data B is obtained from the service cooperation management device 240 based on the read communication information. Then, step S560
The communication with the portable terminal 140 is established by executing the communication establishment process based on the acquired communication object data B, and the e-mail created through steps S554 and S556 is transmitted by the e-mail communication method. Sent to terminal 140.

When the presenter receives, at portable terminal 140, an e-mail indicating that the operation right of projector 200 can be set, the received e-mail is attached with the e-mail address of the response destination. The user clicks and sends a response mail to the virtual object management device 100 by a communication method in an electronic mail format.
Upon receiving the response mail, the virtual object management device 100 sets the operation right of the projector 200 via steps S562 and S564. Next, through step S506, the communication information is read from the communication information registration table 500 based on the service information of the projector 200, and the communication object data A is obtained from the service cooperation management device 240 based on the read communication information. Is done. Then, through step S508, communication with the projector 200 is established by executing communication establishment processing based on the acquired communication object data A, and the area 200 is notified to the projector 200.

In projector 200, upon receiving the notification of the area-in, the service related to the notification of the area-in is set to P.
Since it is a DA service, steps S512 and S5
Through 14, the communication information of the PDA service is read from the communication information registration table 500, and the communication object data B is acquired from the service cooperation management device 240 based on the read communication information. Then, step S5
16, the mobile terminal 1 executes the communication establishment process based on the obtained communication object data B via S524.
Communication with the mobile terminal 140 is established, and a service cooperation start request and a projector display data transmission request are transmitted to the portable terminal 140 by a communication method using an e-mail format.

When the portable terminal 140 receives the service cooperation start request, the service associated with the received service cooperation start request is a projector service, and the communication information of the projector service is stored in the communication information registration table 500 via step S520. The communication object data A is read based on the read communication information.
Is acquired from the service cooperation management device 240. Next, through step S522, communication with the projector 200 is established by executing communication establishment processing based on the acquired communication object data A, and cooperation with the projector service is started. Then, when the projector display data transmission request is received during the cooperation of the projector service, the projector display data designated for the presentation is read through steps S530 and S532, and the read projector display data is stored in the projector 200. Sent to.

When the projector 200 receives the projector display data, the projection is performed by the projection device 82 based on the received projector display data via steps S536 and S538, and the response that the notification of the area-in has been received is virtual. The object management device 100 is notified. Upon receiving the response to the notification of the area-in, the virtual object management device 100 proceeds to step S5.
42, the service ID of the projector service is registered in the area-in management information of the PDA service,
It is managed that the service and the projector service are cooperating.

Next, when the presenter displays the graph during the projection of the presentation and gives an explanation about the X axis on the display screen, the presenter uses the portable terminal 14.
The X-axis is designated on the display screen by operating the 0 key panel 84. In the mobile terminal 140, when an operation is input from the key panel 84, the process goes through steps S566 and S568,
The operation content including the input operation strength is the projector 2
Sent to 00.

Upon receiving the projector display data, the projector 200 obtains the emphasis designation information from the received projector display data via step S700. In this case, the emphasis designation information is acquired, which indicates that the X axis is blinked when the X axis is designated, and that the Y axis is blinked when the Y axis is designated. And
If you receive an action while projecting a presentation,
Through steps S702 to S710, the received operation content indicates the X-axis. Therefore, the information related to the X-axis operation is detected as the enhanced operation information from the received operation content, and based on the detected enhanced operation information. The X axis blinks in the display screen. Here, the degree of blinking of the X axis is determined according to the strength of the operation performed by the presenter. For example, when the X-axis is instructed by a quick operation, the degree of blinking of the X-axis increases, and when the X-axis is instructed by a slow operation, the degree of blinking of the X-axis decreases. .

Further, in the case where the presenter displays the above graph during the projection of the presentation and gives an explanation about the Y axis on the display screen, the presenter uses the portable terminal 14.
By operating the 0 key panel 84, the user designates the Y axis in the display screen. In the mobile terminal 140, when an operation is input from the key panel 84, the process goes through steps S566 and S568,
The operation content including the input operation strength is the projector 2
Sent to 00.

Upon receiving the projector display data, the projector 200 obtains the emphasis designation information from the received projector display data via step S700. When the operation content is received during the projection of the presentation, the received operation content indicates the Y axis through steps S702 to S710.
The information related to the operation on the Y-axis is detected as the emphasized operation information from the received operation content, and the Y-axis blinks in the display screen based on the detected emphasized operation information. Here, the degree of blinking of the Y axis is performed according to the strength of operation by the presenter. For example, when the Y axis is designated by a quick operation,
If the degree of blinking of the axis increases and, on the other hand, the Y-axis is instructed by a slow operation, the degree of blinking of the Y-axis decreases.

When the presenter desires to advance or return the presentation by one page during the projection of the presentation, the presenter inputs an operation for instructing such advance to the key panel 84 of the portable terminal 140. In the portable terminal 140, when an operation is input from the key panel 84, the input operation content is transmitted to the projector 200 via steps S566 and S568.

When the projector 200 receives the operation content during the projection of the presentation, the operation proceeds to step S70.
Through steps S <b> 712 to S <b> 712, projection control for performing projection by the projection device 82 is performed according to the received operation content. For example, if the received operation content indicates that the presentation being projected is advanced by one page, the projection being projected advances one page, and the received operation content indicates that the presentation is returned one page. For example, the presentation being projected returns to the previous page.

In the above case, the presenter can freely determine whether to explain the X-axis or the Y-axis first at the time of presentation. Of course, when only one axis is to be described and the description of the other axis is to be omitted, the other axis need be specified. Therefore, the presenter can make a presentation without being bound by the prior setting at the time of the presentation, and can also flexibly change the content of the presentation at the time of the presentation according to the reaction of the viewer.

Next, in order for the presenter to finish the presentation, the portable terminal 140 is held by the projector 200.
Move away from Thus, when the virtual object B is out of the virtual object A, the virtual object management apparatus 100 reads communication information from the communication information registration table 500 based on the service information of the projector 200 through steps S600 to S608,
The communication object data A is acquired from the service cooperation management device 240 based on the read communication information.
Then, through step S610, communication with the projector 200 is established by executing communication establishment processing based on the acquired communication object data A, and the area out is notified to the projector 200.

When the projector 200 receives the area-out notification, the service related to the area-out notification is the PDA service.
After S616, the communication information of the PDA service is read from the communication information registration table 500, and the communication object data B is acquired from the service cooperation management device 240 based on the read communication information. Then, through steps S618 and S624, communication with the mobile terminal 140 is established by executing communication establishment processing based on the acquired communication object data B, and a service cooperation end request is sent to the mobile terminal 140 using a communication method in an e-mail format. And a response to the effect that the notification of the area out has been received is transmitted to the virtual object management apparatus 100.

When the portable terminal 140 receives the service cooperation end request, the service associated with the received service cooperation end request is a projector service, and the cooperation with the projector service ends through step S622. On the other hand, when receiving the response to the notification of the area-out, the virtual object management apparatus 100 deletes the service ID of the projector service from the area-in management information of the PDA service through step S628, and the cooperation between the PDA service and the projector service is terminated. The completion is managed.

In the above description, the portable terminal 140 is moved closer to the projector 200 to make the virtual object B area-in to the virtual object A, so that the projector display data of the portable terminal 140 is
Has been described, but the portable terminal 140 is moved closer to the printer 220 so that the virtual object B is area-into the virtual object C, whereby the portable terminal 140 is projected.
When the projector display data is printed by the printer 220, it can be performed in the same manner.

As described above, in the present embodiment, when projector display data is given, projector 200 performs projection control of the presentation based on the given projector display data, and operates during projection of the presentation. When the content is received, the projection control of the presentation is performed in accordance with the received operation content, and, based on the emphasis designation information included in the given projector display data, the received operation content related to the emphasis effect is emphasized. It is detected as operation information, and an emphasis effect is given on the display screen based on the detected emphasis operation information.

As a result, the emphasis effect can be given in accordance with the contents of the emphasis effect set in advance in the projector display data and according to the content of the presenter's operation during the presentation. This makes it easy to give an emphasis effect in accordance with the content of the presenter's presentation, and makes it possible to make a flexible and smooth presentation. Further, in the present embodiment, portable terminal 140 includes the strength of the operation input on key panel 84 in the operation content and transmits the operation content to projector 200, and when projector 200 receives the operation content, Is designed to change the degree of the emphasis effect according to the strength of the operation included in the received operation content.

As a result, the degree of the emphasis effect can be changed according to the intensity of the operation performed by the presenter.
Characteristic presentations can be produced depending on relatively unique presentations and presentation methods. Further, in the present embodiment, virtual object management apparatus 100 associates and registers object information on the shape and arrangement position of virtual object A with projector 200, and stores object information on the shape and arrangement position of virtual object B in portable terminal 140. While updating the arrangement position of the virtual object B based on the received position information, the virtual object B refers to the virtual object management table 400 and the virtual object B is in the area of the virtual object A. Is determined, the notification of the area-in is transmitted to the projector 200. When the projector 200 receives the notification of the area-in, the projector 200 issues a transmission request of the projector display data to the portable terminal 14.
0, and when projector display data is received by the transmission, the projection device 82 performs projection based on the received projector display data. While transmitting the position information to the virtual object management device 100, when receiving the request for transmitting the projector display data,
To be sent to.

With this configuration, the virtual objects A and B have shapes and arrangement positions, and it is determined whether or not the virtual object B is in the area of the virtual object A. Since the area to be projected is relatively clear, it is possible to provide different services in small units, for example, several meters, and to provide the area where the projection service is provided (the area of the virtual object A) and the mobile phone. Since the area associated with the terminal 140 (the area of the virtual object B) has a predetermined range instead of a point, the presenter can easily receive the projection service. In addition, the presenter selects the virtual object A
It is possible to receive the projection service simply by bringing the mobile terminal 140 to or near the area, so that the projection service can be received relatively easily and the presenter can be specified to some extent. Thus, a projection service using projector display data according to the presenter can be provided.

Further, in the present embodiment, when it is determined that virtual object B is in area with respect to virtual object A, virtual object management apparatus 100 indicates that the operation right of projector 200 can be set. When an e-mail is transmitted to the portable terminal 140 and a response e-mail to the e-mail is received, the operation right of the projector 200 is set. Projection is performed.

As a result, the portable terminal 140 can perform communication by a simple and low-load communication method, so that the portable terminal 140 can be suitably used as a medium for detecting the movement of the presenter. In addition, the presenter uses the mobile terminal 1
The projector 200 can output by simply sending a response e-mail to the e-mail indicating that the operation right can be set with the user approaching the projector 200 with the user 40.

Furthermore, in this embodiment, the e-mail indicating that the operation right can be set includes the e-mail address of the virtual object management device 100 to which the response is to be sent. This allows the presenter to send a response to the e-mail address included in the received e-mail, thereby reducing the labor required to use projector 200.

Further, in this embodiment, when projector 200 receives the area-in notification, it acquires communication object data B from service cooperation management device 240, and performs communication based on acquired communication object data B. By executing the establishment process, a transmission request of the projector display data is transmitted to the portable terminal 140.

Thus, if the projector 200 can access the service cooperation management device 240, it can provide the projection service without having the communication object data B.
Forty models can be added irrespective of the number of models, the number, and the like, and the addition of the projector 200 is relatively easy. When there are a plurality of mobile terminals 140, object data for communication with the mobile terminals 140 can be centrally managed by the service cooperation management device 240.

Further, in this embodiment, the virtual object management device 100 refers to the virtual object management table 400 to determine whether or not the virtual object B is in the area of the virtual object A. I have. Thereby, the virtual object management device 10
Since the area-in determination is made at 0, the mobile terminal 1
The processing load on the portable terminal 140 can be reduced as compared with the case where the processing is performed at 40. The same applies to the determination as to whether or not an area is out.

Further, in the present embodiment, the portable terminal 14
0 stores the projector display data and transmits the projector display data. This allows
Since the transmission of the projector display data is performed by the mobile terminal 140, the processing load on the virtual object management device 100 can be reduced as compared with the case where the transmission is performed by the virtual object management device 100.

In the above embodiment, the projector display data corresponds to the display data described in the first, second, eighth, tenth, or twelfth aspect, and the projector 200 operates according to the second, third, seventh, eighth, tenth, or the twelfth aspect. The virtual object management DB 42 corresponds to the first storage unit according to claim 8 or the second storage unit according to claim 8. . The RAM 94 corresponds to the display data storage means described in claim 8, and the projection device 82 includes
The key panel 8 corresponds to the display means described in 10 or 12.
4 corresponds to the operation state detecting means according to claim 1 or the operation input means according to claim 2, 3, or 8.

Further, in the above embodiment, the position information acquisition device 86 corresponds to the position information acquisition means described in claim 8, and steps S700 to S714 are executed in steps S700 to S714. It corresponds to display control means. In the above embodiment, the projector 2
00, when the projector display data is given,
The projection control of the presentation is performed based on the given projector display data, and when the operation content is received during the projection of the presentation, the projection control of the presentation is performed according to the received operation content, while the given projector display data is provided. Is configured to detect, as emphasizing operation information, information relating to the emphasizing effect among the received operation contents based on the emphasis specifying information included in the However, the present invention is not limited to this.

As a specific configuration, the portable terminal 140
Has a voice input device such as a microphone that inputs voice as data, and transmits voice data input by the voice input device to the projector 200. Projector 200
When voice data is received during the projection of a presentation, voice recognition is performed based on the received voice data, and the voice recognition results related to the emphasis effect are detected as emphasized voice information. An emphasis effect is given in the display screen based on the information. With this, the presenter can specify and set in advance the location and the content to be emphasized in the projector display data in the projector display data. Along with this, an emphasis effect is given on the display screen. Even with such a configuration, the same effects as above can be obtained.

In this case, the projector display data corresponds to the display data according to the first, fourth, ninth, eleventh, or thirteenth aspect.
14. The display device according to claim 9, 11, or 13, or claim 7.
The virtual object management DB 42 corresponds to the first storage unit according to the ninth aspect, or corresponds to the second storage unit according to the ninth aspect. Also, RAM
94 corresponds to the display data storage means of claim 9,
The projection device 82 corresponds to the display means according to claim 1, 4, 9, 11, or 13, the key panel 84 and the voice input device correspond to the operation state detection means according to claim 1, and the voice input device is , Or a voice input unit according to the fourth or ninth aspect.

Further, the position information acquisition device 86 has
Steps S700 to S700 correspond to the described position information acquisition means.
Step S714 corresponds to the display control unit described in claims 1, 4, 5, 9, 11, or 13. Further, in the above embodiment, when the operation state of the presenter is detected by voice recognition, as described above, the voice recognition result related to the emphasis effect is detected as emphasized voice information, and the detected emphasized voice information is detected. In addition to a configuration in which an emphasis effect is provided in the display screen based on the audio data, a configuration in which the degree of the emphasis effect is determined in accordance with the strength of the audio reproduced by the audio data may be considered. A configuration is also conceivable in which a keyword relating to the degree of the emphasis effect is registered in advance, and when the result of speech recognition includes the keyword, the degree of the emphasis effect is increased. For example, during the presentation, the degree of emphasis can be made different between the case where "XX is exactly ~" and the case where merely "XX is ~".
In this case, “exactly” is registered as a keyword regarding the degree of the emphasis effect.

In the above embodiment, the projector 200 is provided with a function of performing projection control of a presentation based on projector display data and a function of providing an emphasis effect in a display screen based on emphasis designation information. However, the present invention is not limited to this. For example, as shown in FIGS. 16 and 20, these functions may be provided in separate devices. In FIGS. 16 and 20, a projector 20 having a function of performing projection control of a presentation based on projector display data, instead of projector 200 in the above-described embodiment.
0 and a projector management terminal 260 having a function of giving an emphasis effect in a display screen based on emphasis designation information.

FIGS. 16 to 19 are views showing a configuration in which an emphasis effect is given on the display screen in accordance with the content of the operation performed by the presenter. When giving a presentation with this configuration, first, as shown in FIG.
To send the projector display data. When receiving the projector display data, the projector management terminal 260 acquires the emphasis designation information from the received projector display data as shown in FIG. 17 and performs display by the projector 200 based on the received projector display data.

Next, as shown in FIG. 18, the presenter
When the explanation about the Y axis is given verbally, and the operation about the Y axis is input from the key panel 84 of the portable terminal 140, the portable terminal 140 transmits the operation contents about the Y axis to the projector management terminal 260. When receiving the operation content related to the Y axis during the projection of the presentation, the projector management terminal 260 detects the emphasized operation information from the received operation content related to the Y axis based on the emphasis designation information. Here, the degree of the emphasis effect is also determined according to the strength of the operation included in the operation content. And FIG.
As shown in FIG. 9, an emphasis effect is given on the display screen based on the detected emphasis operation information, and the result is displayed by the projector 200.

In this case, the projector 200 and the projector management terminal 260
The projector management terminal 260 corresponds to the display device according to claim 7, 8, 10, or 12, or the projection display device according to claim 7,
It corresponds to the display control means described. FIG. 20 to FIG. 23 are diagrams showing a configuration in which an emphasis effect is given on the display screen according to the content of the utterance made by the presenter.

When a presentation is made with this configuration, the presenter first transmits projector display data from the portable terminal 140 to the projector management terminal 260 as shown in FIG. Projector management terminal 2
At 60, when the projector display data is received,
As shown in FIG. 21, emphasis designation information is acquired from the received projector display data, and the projector 200 performs display based on the received projector display data.

Next, as shown in FIG. 22, the presenter
When the description about the Y-axis is given orally, the portable terminal 140 inputs the utterance of the presenter as data, and transmits the input audio data to the projector management terminal 260.
When audio data is received during projection of the presentation, the projector management terminal 260 performs audio recognition based on the received audio data, and detects emphasis operation information from the audio recognition result based on the emphasis designation information. Here, the degree of the emphasis effect is also determined according to the strength of the sound reproduced by the sound data. Then, as shown in FIG. 23, an emphasis effect is given in the display screen based on the detected emphasis operation information, and the result is displayed on the projector 200.
Display by

In this case, the projector 200 and the projector management terminal 260
14. The display device according to claim 9, 11, or 13, or claim 7.
The projector management terminal 260 corresponds to the display control means according to the first, fourth, fifth, ninth, thirteenth, and thirteenth aspects of the invention. Further, in the above-described embodiment, the portable terminal 140 is configured using the e-mail format as a communication method between the virtual object management device 100, the projector 200, and the printer 220, but is not limited thereto. HT as a communication method
You may comprise using TP (HyperText Transfer Protocol). Even with such a configuration, the same effects as above can be obtained.

In the above embodiment, the virtual object management device 100 is configured to determine whether the virtual object B is in the virtual object A by referring to the virtual object management table 400. However, the present invention is not limited to this, and the virtual object management table 400 may be provided in the mobile terminal 140 and the mobile terminal 140 may determine whether or not the area is in.

[0135] Thus, the area-in is determined by the portable terminal 140, so that the processing load of the virtual object management device 100 can be reduced as compared with the case where the determination is made by the virtual object management device 100. The same applies to the determination as to whether or not an area is out.
Of course, the present invention is not limited to this, and the determination whether or not the area is in may be performed by the projector 200, the printer 220, the service cooperation management device 240, and other devices.

Further, in the above embodiment, the transmission of the projector display data is performed by the portable terminal 140. However, the present invention is not limited to this. The transmission of the display data may be performed by the virtual object management device 100. Thereby, the transmission of the projector display data is performed by the virtual object management device 100, so that the processing load on the mobile terminal 140 can be reduced.

Of course, the transmission of the projector display data is not limited to this.
0, the service cooperation management device 240 or another device may be used. Further, in the above-described embodiment, the virtual object management device 100 and the service cooperation management device 240 are provided and configured. However, the present invention is not limited thereto, and they may be configured as an integrated device.

In the above embodiment, the object information and the service information are transmitted and received wirelessly. However, the present invention is not limited to this, and the object information and the service information may be transmitted or received via a network. You may comprise so that it may be stored in storage media, such as a card chip and a two-dimensional barcode, and may be performed via it. Further, in the above embodiment, the portable terminal 140 has the configuration shown in FIGS.
However, the mobile terminal 140 does not have such a program, and the virtual object management apparatus 100 does not have the object information. The mobile terminal 140 may be configured to interpret the object information and the service information by executing the program only by giving the received program the positional information.

As a result, the virtual object management device 1
00, a new service can be received without changing the internal settings of the mobile terminal 140. Further, in the above embodiment, the object information and the service information are configured to be stored in the virtual object management device 100. However, the present invention is not limited to this, and the object information and the service information may be stored in different devices. , Virtual object management device 1
00 may be configured to store only access information (for example, a shortcut) for accessing them. The mobile terminal 140 obtains access information from the virtual object management device 100, and obtains object information and service information based on the access information.

Further, in the above-described embodiment, the case where the control programs stored in the ROM 32 are executed before executing the processes shown in the flowcharts of FIGS. 5 to 7 has been described. Instead, the program may be read from the storage medium storing the program indicating these procedures into the RAM 34 and executed.

Further, in the above-described embodiment, a case has been described in which the control programs stored in the ROM 72 are executed before executing the processing shown in the flowcharts of FIGS. 9 to 11.
However, the present invention is not limited to this, and the program may be read from the storage medium storing the program indicating these procedures into the RAM 74 and executed.

Further, in the above-described embodiment, the case where the control programs stored in the ROM 92 are executed in executing the processes shown in the flowcharts of FIGS. 13 to 15 has been described. Instead, the program is stored in a RAM 94 from a storage medium storing a program indicating these procedures.
May be read and executed.

Here, the storage medium is a semiconductor storage medium such as a RAM or a ROM, a magnetic storage type storage medium such as an FD or HD, an optical reading type storage medium such as a CD, CDV, LD, DVD, or an MO. A magnetic storage type / optical readout type storage medium includes any storage medium that can be read by a computer regardless of an electronic, magnetic, optical, or other read method.

Also, in the above embodiment, the display control system, the display service providing system,
As shown in FIG. 1, a display object and a display device program are presented in a presentation hall where a presentation is performed, and a virtual object A having a spherical shape is provided in a region surrounding the projector 200 in a region surrounding the portable terminal 140 for use by a presenter. Is applied to the case where the virtual object B is arranged and set, and the projection service by the projector 200 is started based on the projector display data of the portable terminal 140 when the virtual objects A and B overlap each other. However, the present invention can be applied to other cases without departing from the gist of the present invention.

[0145]

As described above, according to the display control system of the first aspect of the present invention, according to the content of the highlighting effect set in advance in the display data, the user of the user who is presenting is presented. Since the emphasis effect can be given according to the operation state, it is easier to give the emphasis effect in accordance with the contents of the user's presentation than before, and the effect that the presentation can be made flexible and smooth can be made. can get.

Further, according to the display control system according to the second or third aspect of the present invention, the display control system is adapted to the contents of the highlighting effect set in advance in the display data and to respond to the operation contents of the user during the presentation. Therefore, it is easier to give an emphasis effect in accordance with the content of the user's presentation, and it is possible to provide a flexible and smooth presentation as compared with the related art.

Further, according to the display control system of the third aspect of the present invention, the degree of the emphasis effect can be changed according to the strength of the operation by the user, so that a relatively individual presentation or presentation is made. Depending on the way, it is also possible to produce a characteristic presentation. Furthermore, according to the display control system according to claims 4 to 6 of the present invention, the emphasis effect is set in accordance with the content of the emphasis effect set in advance in the display data and in accordance with the utterance content of the user who is presenting. , It is easier to give an emphasis effect in accordance with the content of the user's presentation, and it is possible to provide a flexible and smooth presentation.

Further, according to the display control system of the fifth aspect of the present invention, the degree of the emphasis effect can be changed according to the strength of the utterance made by the user, so that a relatively individual presentation or presentation is made. Depending on the way, it is also possible to produce a characteristic presentation. on the other hand,
According to the display service providing system according to claim 8 of the present invention, the emphasis effect is given in accordance with the content of the emphasis effect set in advance in the display data and according to the operation content of the user during the presentation. Therefore, it is easier to give an emphasis effect in accordance with the contents of the user's presentation, and it is possible to provide a flexible and smooth presentation as compared with the related art. Furthermore, a display service is provided as compared with the related art by a configuration in which the virtual object has a shape and an arrangement position and determines whether or not the area of the first virtual object and the area of the second virtual object overlap. Since the area to be displayed is relatively clarified, it is possible to provide different display services in small units, for example, several meters, and the display service is provided in an area and a mobile terminal. Since the area has a predetermined range instead of a point, the user can easily receive the display service. In addition, since the user can receive the display service simply by taking the mobile terminal to or near the area of the first virtual object, the user can receive the display service relatively easily. Can be specified to some extent, and an effect that a display service suitable for the user can be provided is also obtained.

Further, according to the display service providing system according to the ninth aspect of the present invention, the display data is provided in accordance with the contents of the highlighting effect set in advance in the display data and according to the contents of the utterance of the user who is presenting. Since an emphasis effect can be given, it is easier to give an emphasis effect in accordance with the content of the user's announcement than before, and an effect that a flexible and smooth announcement can be made can be obtained. Furthermore, a display service is provided as compared with the related art by a configuration in which the virtual object has a shape and an arrangement position and determines whether or not the area of the first virtual object and the area of the second virtual object overlap. Since the area to be displayed is relatively clarified, it is possible to provide different display services in small units, for example, several meters, and the display service is provided in an area and a mobile terminal. Since the area has a predetermined range instead of a point, the user can easily receive the display service. In addition, since the user can receive the display service simply by taking the mobile terminal to or near the area of the first virtual object, the user can receive the display service relatively easily. Can be specified to some extent, and an effect that a display service suitable for the user can be provided is also obtained.

On the other hand, according to the display device of the tenth aspect of the present invention, the same effect as that of the display control system of the second aspect can be obtained. Further, according to the display device of the eleventh aspect of the present invention, the same effect as that of the display control system of the fourth aspect can be obtained. On the other hand, according to the display device program according to claim 12 of the present invention,
The same effect as that of the display device described can be obtained.

Further, according to the display device program of the present invention, the same effects as those of the display device of the present invention can be obtained.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a network system to which the present invention is applied.

FIG. 2 is a block diagram showing a configuration of a virtual object management device 100.

FIG. 3 is a diagram showing a data structure of a virtual object management table 400.

FIG. 4 is a diagram showing a data structure of a communication information registration table 500.

FIG. 5 is a flowchart illustrating an object information update process.

FIG. 6 is a flowchart illustrating an area-in notification process.

FIG. 7 is a flowchart showing an area out notification process.

FIG. 8 is a block diagram showing a configuration of a projector 200.

FIG. 9 is a flowchart illustrating an area-in notification response process.

FIG. 10 is a flowchart illustrating an area-out notification response process.

FIG. 11 is a flowchart showing a projection process.

FIG. 12 is a block diagram showing a configuration of a portable terminal 140.

FIG. 13 is a flowchart showing a position information notification process.

FIG. 14 is a flowchart illustrating a service cooperation process.

FIG. 15 is a flowchart illustrating a projector display data transmission process.

FIG. 16 is a diagram showing a configuration in a case where an emphasis effect is given in a display screen according to the content of an operation performed by a presenter.

FIG. 17 is a diagram showing a configuration in a case where an emphasis effect is given on a display screen according to the content of an operation performed by a presenter.

FIG. 18 is a diagram showing a configuration in a case where an emphasis effect is given on a display screen according to the content of an operation performed by a presenter.

FIG. 19 is a diagram showing a configuration in a case where an emphasis effect is given on a display screen according to the content of an operation performed by a presenter.

FIG. 20 is a diagram showing a configuration in a case where an emphasis effect is given in a display screen according to the content of a speech by a presenter.

FIG. 21 is a diagram showing a configuration in a case where an emphasis effect is given on a display screen in accordance with the content of an utterance made by a presenter.

FIG. 22 is a diagram showing a configuration in a case where an emphasis effect is given on a display screen in accordance with the content of an utterance made by a presenter.

FIG. 23 is a diagram showing a configuration in a case where an emphasis effect is given in a display screen according to the content of an utterance made by a presenter.

[Explanation of symbols]

Reference Signs List 100 virtual object management device 140 portable terminal 200 projector 220 printer 240 service cooperation management device 260 projector management terminal 400 virtual object management table 500 communication information registration table 30, 70, 90 CPU 32, 72, 92 ROM 34, 74, 94 RAM 38 , 78, 98 I / F 40, 80, 83 Wireless communication device 42 Virtual object management DB 86 Position information acquisition device 84 Key panel 85 LCD 82 Projection device

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Shinya Taniguchi 3-3-5 Yamato, Suwa-shi, Nagano F-term (reference) in Seiko Epson Corporation 5B069 AA01 BA04 HA01 KA01 LA03 5C082 AA03 AA21 BA02 BA12 BB01 CA82 CB05 DA51 MM09 MM10

Claims (13)

[Claims] When display data including emphasis designation information on the contents of an emphasis effect to be given in a display screen is given, a display is performed based on the given display data, and the emphasis effect is given in the display screen. A display unit, an operation state detection unit that detects an operation state of a user, and a display control unit that performs display control to display a screen on the display unit based on the display data. When the display data is given, the display control means performs the display control based on the given display data, while detecting the emphasis designation information included in the given display data and the operation state detecting means. A display control system for giving an emphasis effect in the display screen based on the operating state. 2. A portable terminal for use by a user and a display device are communicably connected to each other, and when display data including emphasis designation information on the content of an emphasis effect to be given on a display screen is given, A system that performs display based on the obtained display data and gives an emphasis effect in the display screen, wherein the mobile terminal has operation input means for inputting an operation by the user, and the operation input means The input operation content is transmitted to the display device, the display device includes display means, and display control means for performing display control for displaying a screen on the display means based on the display data. When the display data is provided, the display control means performs the display control based on the provided display data, and receives the operation content during the display control. When performing the display control in accordance with the received operation content, based on the emphasis designation information included in the given display data, the received operation content related to the emphasis effect as emphasis operation information A display control system, wherein the display control system detects and provides an emphasis effect in the display screen based on the detected emphasis operation information. 3. The mobile terminal according to claim 2, wherein the mobile terminal transmits the strength of the operation input by the operation input unit to the display device while including the intensity of the operation in the operation content. , When the operation content is received,
A display control system wherein the degree of an emphasis effect is changed according to the strength of an operation included in a received operation content. 4. A portable terminal for use by a user and a display device are communicably connected to each other, and when display data including emphasis designation information on the contents of an emphasis effect to be given on a display screen is given, A system that performs display based on the obtained display data and gives an emphasis effect in the display screen, wherein the mobile terminal has voice input means for inputting voice as data, and the mobile terminal performs input by the voice input means. The display device, the display device, and display control means for performing display control to display a screen on the display means based on the display data, the display device, Voice recognition means for performing voice recognition based on voice data, wherein the display control means, when the display data is given, based on the given display data While performing the display control, based on the emphasis designation information included in the given display data, a recognition result of the speech recognition unit that is related to an emphasis effect is detected as emphasized speech information. A display control system characterized in that an emphasis effect is given in the display screen on the basis of the following. 5. The display control unit according to claim 4, wherein when the audio data is received, the display control means changes the degree of the emphasis effect according to the strength of the audio reproduced by the received audio data. And a display control system. 6. The speech recognition unit according to claim 5, wherein the speech recognition unit holds a keyword regarding the degree of the enhancement effect, and determines the degree of the enhancement effect based on the presence or absence of the keyword regarding the degree of the enhancement effect in addition to the strength of the sound of the voice data. A display control system characterized in that the display control system changes 7. The display control system according to claim 2, wherein the display device is a projection display device. 8. A portable terminal for use by a user and a display device are communicably connected, a first virtual object is associated with the display device, and a second virtual object is associated with the portable terminal. Disposing the first virtual object on a virtual space corresponding to the first virtual object, and disposing the second virtual object at or near the position of the portable terminal in the virtual space, wherein the first virtual object and the second virtual object A display service for displaying a display device corresponding to the first virtual object based on the positional relationship of the first virtual object; First storage means for storing in association with, and the shape and arrangement position of the second virtual object Storage means for storing second object information relating to the portable terminal in association with the portable terminal, and display data including emphasis designation information relating to the content of the emphasis effect given in the display screen in association with the portable terminal. Display data storage means for performing the operation, and position information acquisition means for acquiring position information for specifying the position of the portable terminal, and the second storage means based on the position information acquired by the position information acquisition means. And updating, based on the first object information of the first storage means and the second object information of the second storage means, an area specified by the shape and the arrangement position of the first virtual object. When it is determined that the area specified by the shape and the arrangement position of the second virtual object overlaps,
The display data corresponding to the portable terminal corresponding to the second virtual object among the display data of the display data storage means is
The portable terminal has an operation input means for inputting an operation by the user, and the operation content input by the operation input means is displayed on the display device corresponding to the first virtual object. The display device includes a display unit, and a display control unit that performs display control for displaying a screen on the display unit based on the display data, and the display control unit includes: When the display data is received, the display control is performed based on the received display data. When the operation content is received during the display control, the display control is performed according to the received operation content. Detecting, on the basis of the emphasis designation information included in the received display data, an operation related to the emphasis effect among the received operation contents as emphasis operation information, Display service providing system characterized in that it is adapted to provide enhancement effect among said display screen based on the created information. 9. A portable terminal for use by a user and a display device are communicably connected, a first virtual object is associated with the display device, and a second virtual object is associated with the portable terminal. Disposing the first virtual object on a virtual space corresponding to the first virtual object, and disposing the second virtual object at or near the position of the portable terminal in the virtual space, wherein the first virtual object and the second virtual object A display service for displaying a display device corresponding to the first virtual object based on the positional relationship of the first virtual object; First storage means for storing in association with, and the shape and arrangement position of the second virtual object Storage means for storing second object information relating to the portable terminal in association with the portable terminal, and display data including emphasis designation information relating to the content of the emphasis effect given in the display screen in association with the portable terminal. Display data storage means for performing the operation, and position information acquisition means for acquiring position information for specifying the position of the portable terminal, and the second storage means based on the position information acquired by the position information acquisition means. And updating, based on the first object information of the first storage means and the second object information of the second storage means, an area specified by the shape and the arrangement position of the first virtual object. When it is determined that the area specified by the shape and the arrangement position of the second virtual object overlaps,
The display data corresponding to the portable terminal corresponding to the second virtual object among the display data of the display data storage means is
The portable terminal has audio input means for inputting audio as data, and the audio data input by the audio input means is transmitted to the display device corresponding to the first virtual object. The display device includes a display unit, a display control unit that performs display control for displaying a screen on the display unit based on the display data, and a voice recognition unit based on the received voice data. And the display control means, when receiving the display data, performs the display control based on the received display data, while emphasizing designation information included in the received display data. Based on the detected voice recognition means, the one related to the emphasis effect is detected as emphasized voice information, and the display is performed based on the detected emphasized voice information. Display service providing system characterized in that it is adapted to provide enhancement effect among the surfaces. 10. A device which is communicably connected to a portable terminal in the display control system according to claim 2, wherein said display means performs display control for displaying a screen on said display means based on said display data. When the display data is given, the display control means performs the display control based on the given display data, and when the operation content is received during the display control,
While performing the display control according to the received operation content, based on the emphasis designation information included in the given display data, the received operation content related to the emphasis effect is detected as the emphasis operation information, and detected. A display device for giving an emphasis effect in the display screen based on the emphasized operation information. 11. A device communicably connected to a portable terminal in the display control system according to claim 4, wherein said display means performs display control for displaying a screen on said display means based on said display data. Control means, and voice recognition means for performing voice recognition based on the received voice data, the display control means, when the display data is given, the display control based on the given display data On the other hand, based on the emphasis designation information included in the given display data, among the recognition results obtained by the speech recognition means, one related to an emphasis effect is detected as emphasis speech information, and based on the detected emphasis speech information, A display device characterized by giving an emphasis effect in a display screen. 12. A program for causing a display device according to claim 10 to be executed by a computer, wherein the program is realized as display control means for performing display control for displaying a screen on the display means based on the display data. A program for executing a process, wherein the display control means, when the display data is provided, performs the display control based on the provided display data, and receives the operation content during the display control When you do
While performing the display control according to the received operation content, based on the emphasis designation information included in the given display data, the received operation content related to the emphasis effect is detected as the emphasis operation information, and detected. A program for a display device, characterized in that an emphasis effect is given in the display screen based on the emphasized operation information. 13. A program to be executed by a display device according to claim 11, comprising a computer, wherein the program is realized as display control means for performing display control for displaying a screen on the display means based on the display data. A program for executing a process, wherein when the display data is given, the display control means performs the display control based on the given display data, and is included in the given display data. Based on the emphasis designation information, a result related to the emphasis effect among the recognition results of the speech recognition means is detected as emphasis speech information, and the emphasis effect is given in the display screen based on the detected emphasis speech information. A display device program characterized by the following.