WO2016157920A1

WO2016157920A1 - Information processing device, information processing method, and program

Info

Publication number: WO2016157920A1
Application number: PCT/JP2016/050258
Authority: WO
Inventors: 達雄藤原
Original assignee: ソニー株式会社
Priority date: 2015-03-31
Filing date: 2016-01-06
Publication date: 2016-10-06
Also published as: JP2016191854A

Abstract

The purpose of the present invention is to provide an information processing device that makes it possible to project a video in a more suitable mode that corresponds to a use scene. An information processing device provided with a control unit for controlling the operation of a plurality of projection units that makes display information displayed by projecting the display information to at least some of projection areas in the plane of projection, the control unit selectively switching a plurality of operation modes mutually different in a mode for causing a projection area corresponding to each of two or more projection units among the plurality of projection units to be superposed one on another.

Description

Information processing apparatus, information processing method, and program

The present disclosure relates to an information processing apparatus, an information processing method, and a program.

In recent years, so-called projectors that present information by projecting an image on a projection surface such as a screen have been used not only in offices but also in homes, and their usage has expanded. Yes. Also, in recent years, the use of the projector, such as a so-called short-throw projector, in which a casing from which the image is projected can be installed near the wall on which the image is projected. Forms are also diversifying. For example, Patent Document 1 discloses an example of a usage form of a so-called projector.

JP 2005-352171 A

On the other hand, with the diversification of the usage scenes of the projector (for example, the usage, the usage form, and the diversification of the content to be projected), the size of the projected image (that is, the projection scene) There is a demand for a mechanism capable of controlling the projection mode of the video so that the angle of view), the resolution of the video, and the like are set more appropriately.

Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and a program capable of projecting a video in a more preferable manner according to a usage scene.

According to the present disclosure, the control unit includes a control unit that controls operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane, An information processing apparatus is provided that selectively switches a plurality of operation modes different from each other in a mode for superimposing the projection regions corresponding to each of at least two of the plurality of projection units. The

According to the present disclosure, the processor controls the operations of the plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane; An aspect for superimposing the projection regions corresponding to each of at least two or more of the plurality of projection units selectively switching a plurality of different operation modes from each other. Is provided.

According to the present disclosure, the computer controls the operations of the plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane; A program for executing a mode in which the projection region corresponding to each of at least two or more of the projection units among the plurality of projection units is selectively switched among a plurality of different operation modes. Provided.

As described above, according to the present disclosure, an information processing apparatus, an information processing method, and a program capable of projecting a video in a more preferable mode according to a usage scene are provided.

Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

FIG. 3 is an explanatory diagram for describing an overview of an information processing apparatus according to an embodiment of the present disclosure. It is explanatory drawing for demonstrating an example of the schematic structure of the information processing apparatus which concerns on the embodiment. 4 is an explanatory diagram for describing an example of a schematic operation of the information processing apparatus according to the embodiment; FIG. 6 is an explanatory diagram for describing another example of the schematic operation of the information processing apparatus according to the embodiment. FIG. It is the block diagram which showed an example of the function structure of the information processing apparatus which concerns on the embodiment. 5 is a flowchart illustrating an example of a flow of a series of operations of the information processing apparatus according to the embodiment. 11 is an explanatory diagram for describing an outline of an operation of an information processing apparatus according to Modification Example 1. FIG. 11 is an explanatory diagram for describing an outline of an operation of an information processing apparatus according to Modification Example 1. FIG. 11 is an explanatory diagram for describing an example of an operation of an information processing apparatus according to Modification 3. FIG. 11 is an explanatory diagram for explaining another example of the operation of the information processing apparatus according to the modification example 3. FIG. 10 is an explanatory diagram for explaining an example of an operation of an information processing apparatus according to Modification Example 4. FIG. 10 is an explanatory diagram for explaining an example of an operation of an information processing apparatus according to Modification Example 5. FIG. 10 is an explanatory diagram for explaining an example of an operation of an information processing apparatus according to Modification Example 5. FIG. 10 is an explanatory diagram for explaining an example of an operation of an information processing apparatus according to Modification Example 5. FIG. It is the figure which showed an example of the hardware constitutions of the information processing apparatus which concerns on the embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. Overview 2. Functional configuration Process 4. Modified example 4.1. Modification Example 1: Control Example for Projecting High Frame Rate Video 4.2. Modification 2: Control example 1 for projecting high-quality video
4.3. Modification 3: Control example 2 for projecting high-quality video
4.4. Modification 4: Example of control for realizing partial high image quality 4.5. Modification 5: Control example for improving followability when changing display mode Hardware configuration Summary

<1. Overview>
First, in order to make the characteristics of the information processing apparatus according to an embodiment of the present disclosure easier to understand, an overview of the information processing apparatus according to the present embodiment will be described with reference to FIG. FIG. 1 is an explanatory diagram for explaining an overview of the information processing apparatus according to the present embodiment.

The information processing apparatus 1 according to the present embodiment is configured as a so-called projector, and projects a video on which desired display information is presented on a desired projection surface, thereby providing the display information to the user. Present. For example, in the example illustrated in FIG. 1, the information processing apparatus 1 is installed vertically above the table 140 or the like, and projects an image on the projection plane R10 with the top surface of the table 140 as the projection plane R10. In the following description, in the example shown in FIG. 1, the vertical direction is the z direction, and the directions orthogonal to each other on the horizontal plane (that is, the directions orthogonal to the z direction and orthogonal to each other) are the x direction and y. Sometimes referred to as a direction.

1, reference numerals R11a and R11b schematically indicate areas in the projection surface R10 (hereinafter, may be referred to as “projection areas”) on which the information processing apparatus 1 projects an image. In the following description, the projection areas R11a and R11b may be simply referred to as “projection area R11” unless they are particularly distinguished.

That is, as shown in FIG. 1, the information processing apparatus 1 according to the present embodiment makes at least a part of the projection plane R10 a projection area R11 and can project an image on each of the plurality of projection areas R11. It is configured.

Here, an example of a schematic configuration of the information processing apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is an explanatory diagram for describing an example of a schematic configuration of the information processing apparatus 1 according to the present embodiment. As shown in FIG. 2, the information processing apparatus 1 according to the present embodiment includes

output units

30a and 30b. In the following description, the

output units

30a and 30b may be simply referred to as “output unit 30” unless they are particularly distinguished. Further, the information processing apparatus 1 may include the input unit 10.

The output unit 30 is configured to present various information to the user. For example, in the example illustrated in FIG. 2, the output unit 30 is installed so as to face the top surface side (that is, the projection surface R <b> 10 side) of the table 140 apart from the table 140. The output unit 30 includes a configuration for projecting an image in a so-called projector (that is, a projection unit), and is configured to be able to project an image on a projection region R11 in the projection surface R10. Further, the output unit 30 according to the present embodiment is configured to be able to control the direction in which an image is projected and the size of the image to be projected (in other words, the angle of view). That is, the output unit 30 is configured to be able to project an image with a desired size at a desired position in the projection plane R10. In other words, the output unit 30 is configured to be able to control the position and size of the projection region R11.

In FIGS. 1 and 2, the projection region R11a indicates a region where the output unit 30a projects an image. Similarly, the projection region R11b indicates a region where the output unit 30b projects an image.

Further, the output unit 30 may include an acoustic device for outputting acoustic information such as a so-called microphone.

The input unit 10 is configured to input the operation contents of the user who uses the information processing apparatus 1 and the shape and pattern of an object placed on the table 140. For example, in the example illustrated in FIG. 2, the input unit 10 is installed so as to face the projection surface R <b> 10 side on which the output unit 30 projects an image while being separated from the table 140.

The input unit 10 can record information in the depth direction by imaging the table 140 with two imaging optical systems, for example, a camera that images the table 140 with one imaging optical system (for example, a series of lens groups). A stereo camera can be included. In addition, the input unit 10 is a sound collection device (for example, a microphone or the like) for collecting acoustic information such as sound emitted by a user who uses the information processing apparatus 1 and environmental sound of the environment where the information processing apparatus 1 is placed. ) May be included.

When the input unit 10 includes a camera that captures the table 140 with a single imaging optical system, the information processing apparatus 1 analyzes an image captured by the camera, for example, so that an object placed on the table 140 is analyzed. Is detected. When the input unit 10 includes a stereo camera, for example, a visible light camera or an infrared camera can be applied to the stereo camera. When the input unit 10 includes a stereo camera, the input unit 10 can acquire depth information. When the input unit 10 acquires depth information, the information processing apparatus 1 can detect a real object such as a hand or an object placed on the table 140, for example. Further, when the input unit 10 acquires the depth information, the information processing apparatus 1 allows the operation body such as the user's hand to contact and approach the projection surface R10 (that is, the top surface of the table 140), and the projection. It is possible to detect the detachment of the operating tool from the surface R10. In the following description, when a user brings an operating tool such as a hand into contact with or close to the projection surface R10, it may be simply referred to as “contact”.

In the following, a case where a user's operation using an operating tool such as a hand is detected from an image captured by the input unit 10 will be mainly described, but the present disclosure is not limited to such an example. The user's operation may be detected by a touch panel that detects contact of the user's finger or the like. Other user operations that can be acquired by the input unit 10 may include, for example, a stylus operation on the projection plane R10, a gesture operation on the camera, and the like.

Further, when the input unit 10 includes a sound collection device such as a microphone, the input unit 10 may acquire a voice accompanying the user's utterance as a voice input.

The input unit 10 may include a detection device for detecting a change in the external environment, such as an optical sensor. In this case, the input unit 10 may acquire a detection result by the detection device as input information.

With the above-described configuration, for example, the information processing apparatus 1 is based on various types of input information acquired by the input unit 10, and input information (for example, operation content and instruction content) from the user, and changes in various states and situations. And the operation of the output unit 30 can be controlled according to the recognition result.

Heretofore, an example of a schematic configuration of the information processing apparatus 1 according to the present embodiment has been described with reference to FIGS. 1 and 2.

Note that the configuration of the information processing apparatus 1 illustrated in FIGS. 1 and 2 is merely an example, and the information processing apparatus 1 includes a plurality of output units 30 and can control each of the plurality of output units 30 independently. The configuration of the device 1 is not necessarily limited to the examples shown in FIGS. As a specific example, the information processing apparatus 1 projects an image on the wall surface with a wall surface extending in the vertical direction as a projection surface (that is, the image is projected from the position facing the wall surface toward the wall surface. Projecting). Further, the information processing apparatus 1 may be configured as a so-called short focus projector. Further, the information processing apparatus 1 is configured as a so-called rear projection type projector that projects an image from the back side of a projection surface formed of a transparent material such as a glass plate or a transparent plastic plate. May be.

Moreover, in the example demonstrated with reference to FIG.1 and FIG.2, although the information processing apparatus 1 demonstrated an example of the structure containing the input part 10 and the

output parts

30a and 30b, the structure of the information processing apparatus 1 is shown. However, the present invention is not necessarily limited to the examples shown in FIGS. As a specific example, at least a part of the input unit 10 and the

output units

30 a and 30 b may be provided outside the information processing apparatus 1. In this case, for example, the information processing apparatus 1 may establish communication with a configuration provided outside and control the operation of the configuration via the communication. In the above description, the example in which the information processing apparatus 1 includes the input unit 10 has been described. However, if the information processing apparatus 1 includes a plurality of output units 30 and can control the operations of the output units 30, The input unit 10 is not necessarily included.

In the example described with reference to FIGS. 1 and 2, the example in which the information processing apparatus 1 includes two output units 30 (that is, the

output units

30 a and 30 b) has been described. However, a plurality of output units 30 are included. The number is not necessarily limited to the examples shown in FIGS. As a specific example, the information processing apparatus 1 may include four output units 30, and each of the four output units 30 may project an image onto the projection plane R10.

Next, an example of a schematic operation of the information processing apparatus 1 according to the present embodiment will be described. For example, FIG. 3 is an explanatory diagram for explaining an example of a schematic operation of the information processing apparatus 1 according to the present embodiment. The information processing apparatus 1 includes four output units 30 (here, the output units 30a to 30a). 30d) is illustrated as an example in which the operation can be controlled. In FIG. 3, reference numeral R11a indicates a projection area in which the output unit 30a projects an image. Similarly, reference numerals R11b to R11d indicate projection areas in which the output units 30b to 30d project images.

As described above, the information processing apparatus 1 according to the present embodiment is configured to be able to control the operations of the plurality of output units 30. Each of the output units 30 is configured to be able to control the position and size of the projection region R11. Based on such a configuration, for example, as illustrated in FIG. 3, the information processing apparatus 1 controls each operation of the plurality of output units 30 individually, so that a desired position in the projection plane R10 is obtained. It is possible to project an image of the direction and size.

For example, in the example shown in FIG. 3, the information processing apparatus 1 recognizes the positions of the users Ua to Uc with respect to the projection plane R10 based on the input information from the input unit 10, and outputs the output units 30a to 30c according to the recognition result. Each operation of 30d is controlled.

Specifically, the information processing apparatus 1 controls the operation of the output unit 30c based on the recognition result of the position of the user Ua so that the projection region R11c corresponding to the output unit 30c is located in the vicinity of the user Ua. is doing. At this time, the information processing apparatus 1 may cause the output unit 30c to adjust the orientation of the video so that the video projected on the projection plane R11c and the user Ua face each other.

Further, the information processing apparatus 1 controls the operation of the output unit 30d based on the recognition result of the position of the user Ub so that the projection region R11d corresponding to the output unit 30d is located in the vicinity of the user Ub. . Similarly, the information processing apparatus 1 outputs the

output units

30a and 30b so that the projection regions R11a and R11b corresponding to the

output units

30a and 30b are located in the vicinity of the user Uc based on the recognition result of the position of the user Uc. Is controlling the operation.

Note that the information processing apparatus 1 individually controls the angle of view of each output unit 30, so that the size of the projection region corresponding to the output unit 30 (in other words, the image projected by the output unit 30 can be reduced). (Size) may be controlled.

Thus, for example, the information processing apparatus 1 according to the present embodiment may independently control each of the plurality of output units 30 and cause each output unit 30 to project an image individually.

In addition, the information processing apparatus 1 according to the present embodiment operates at least a part of two or more output units 30 among the plurality of output units 30 so that the two or more output units 30 cooperate with each other. One image may be projected by the above.

For example, when the output unit 30 projects an image on the projection plane R10, the projection plane R10 depends on the setting of the angle of view and the distance between the output unit 30 and the projection plane R10 (that is, the projection distance). The size of the image projected on the screen is controlled. On the other hand, even when the size of the image projected on the projection surface R10 changes, the resolution of the projected image does not change, so that the user feels the image quality of the image rough according to the size of the image. There is a case. In particular, as shown in FIGS. 1 and 2, when the top surface of the table 140 is the projection plane R10, the distance between the user and the projection plane R10 is likely to be close, so that the size of the image is small. When controlling to be larger, the user tends to feel the image quality of the video more coarsely.

Also, the resolution and the number of pixels of the video that can be projected by the output unit 30 are determined in advance according to the performance and characteristics of the output unit 30. Therefore, when the output unit 30 projects an image with a higher resolution or number of pixels than its own resolution or number of pixels, the resolution or the number of pixels of the image is equal to the resolution or the number of pixels of the output unit 30. There may be restrictions.

Therefore, the information processing apparatus 1 according to the present embodiment forms a single video from the video projected from each of the at least two or more output units 30, thereby projecting a video in a more preferable mode (for example, more Projection of images with high resolution and pixel count).

For example, FIG. 4 is an explanatory diagram for explaining another example of the schematic operation of the information processing apparatus 1 according to the present embodiment. In the example shown in FIG. 4, the information processing apparatus 1 forms one display region by combining the projection regions R11a to R11d of the projection units 30a to 30d, and links the projection units 30a to 30d to each other. Video (in other words, display information) is projected onto the display area.

More specifically, the information processing apparatus 1 controls the direction in which each of the output units 30a to 30d projects an image and the size of the image to be projected (in other words, the width of the angle of view), so that FIG. As shown, the projection regions R11a to R11d are combined. In addition, the information processing apparatus 1 divides the video (display information) to be projected into partial videos according to the coupling relationship between the projection areas R11a to R11d, and the divided partial videos correspond to the projection areas R11. Output to the output unit 30. By such control, the partial images projected from the output units 30a to 30d are combined on the projection plane R10 according to the connection relationship between the projection regions R11a to R11d, so that one image is formed.

At this time, the resolution and the number of pixels of the image projected on each of the projection areas R11a to R11d correspond to the resolution and the number of pixels of the output unit 30 corresponding to the projection area R11. Therefore, in the example shown in FIG. 4, for example, when the resolutions and the number of pixels of the output units 30a to 30d are the same, the resolution and pixels are compared with the case where an image of the same size is projected by the output unit 30 alone. It is possible to project a video image that is four times as many.

Also, as shown in FIG. 4, the information processing apparatus 1 may control the positions at which the projection areas R11a to R11d are projected so that at least a part of the information is overlapped between the adjacent projection areas R11. By such control, it becomes possible to make the boundary between adjacent projection regions R11 (in other words, the difference in luminance value between the projection regions R11) inconspicuous.

The information processing apparatus 1 according to the present embodiment includes an operation (operation mode) for individually controlling each output unit 30 as illustrated in FIG. 3 and two or more output units 30 as illustrated in FIG. 4. The operation (operation mode) to be linked to each other may be configured to be selectively switchable. In other words, the information processing apparatus 1 according to the present embodiment is configured to be able to selectively switch a plurality of operation modes different from each other in a mode for superimposing the projection regions R11 corresponding to the plurality of output units 30, respectively. It may be. In this description, as shown in FIG. 3, the mode for superimposing the projection regions R11 corresponding to each of the plurality of output units 30 is a mode in which the projection regions R11 corresponding to the respective output units 30 are not superimposed. Can also be included as some aspects.

Note that the information processing apparatus 1 according to the present embodiment is not particularly limited in the trigger for switching the operation mode as long as the operation mode as illustrated in FIGS. 3 and 4 can be selectively switched as appropriate.

As a specific example, the information processing apparatus 1 recognizes various operations (for example, gesture operations such as tap and pinch-in / pinch-out) based on input information acquired by the input unit 10, for example. The operation mode may be switched depending on the content. Of course, the type of the operation is not particularly limited as long as the information processing apparatus 1 can recognize the operation mode of the switching destination according to the content of the operation by the user. As a specific example, the information processing apparatus 1 may switch the operation mode based on the contents of operations through various operation devices such as a mouse, a button, and a touch panel.

As another example, the information processing apparatus 1 may switch to a more suitable operation mode in accordance with information related to a projected video (for example, information related to content to be projected). As a specific example, when the information processing apparatus 1 projects an image with a resolution higher than the resolution of each output unit 30 as illustrated in FIG. You may switch to the operation mode which cooperates the two or more output parts 30 so that one display area may be formed. At this time, the information processing apparatus 1 may switch the number of output units 30 to be linked with each other according to the resolution of the video to be projected.

As another example, the information processing apparatus 1 recognizes the state of the external environment according to detection results of detection devices such as various sensors, and enters a more suitable operation mode according to the recognition result of the external environment. You may switch. As a specific example, the information processing apparatus 1 may recognize the position and orientation of the user with respect to the projection plane R10 according to the detection result of the detection device, and determine the operation mode according to the recognition result.

As described above, the information processing apparatus 1 according to the present embodiment is configured to be able to selectively switch the mode for superimposing the projection regions R11 corresponding to the two or more output units 30, respectively. Based on such a configuration, the information processing apparatus 1 according to the present embodiment selectively switches the operation mode according to the usage scene based on the usage, the usage mode, the type of video (content) to be projected, and the like. As a result, it is possible to project the video in a more preferable manner according to the usage scene. In addition, with such a configuration, the information processing apparatus 1 according to the present embodiment can realize a function or performance equivalent to that of a higher-performance output unit (projector) by linking a plurality of output units 30. Therefore, it may be possible to reduce costs and achieve miniaturization.

The outline of the information processing apparatus 1 according to the present embodiment has been described above with reference to FIGS. Hereinafter, the information processing apparatus 1 according to the present embodiment will be described in more detail.

<2. Functional configuration>
First, an example of a functional configuration of the information processing apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 5 is a block diagram illustrating an example of a functional configuration of the information processing apparatus 1 according to the present embodiment.

As illustrated in FIG. 5, the information processing apparatus 1 according to the present embodiment includes an input unit 10, a control unit 20, a storage unit 40, and a plurality of output units 30. In the example illustrated in FIG. 5, the information processing apparatus 1 includes

output units

30 a and 30 b as the plurality of output units 30. Note that the input unit 10 and the

output units

30a and 30b illustrated in FIG. 5 correspond to the input unit 10 and the

output units

30a and 30b in the example illustrated in FIG.

As shown in FIG. 5, the input unit 10 includes an imaging unit 11, for example. The input unit 10 may include a detection unit 13.

The imaging unit 11 corresponds to the configuration for imaging the image of the projection plane R10 described above with reference to FIG. 2, and for example, a camera including one imaging optical system or a stereo camera including two imaging optical systems. Can be configured. The imaging unit 11 outputs the captured image of the projection plane R10 to the control unit 20.

The detection unit 13 corresponds to a detection device such as various sensors for detecting various states. As a specific example, the detection unit 13 is configured as a so-called depth sensor, and includes an information processing apparatus 1 and an object (for example, an operating body such as a hand) positioned within a predetermined detection range starting from the information processing apparatus 1. Or the distance to the projection plane R10), and control information indicating the measurement result may be generated. As another example, the detection unit 13 is configured as a sensor for detecting a user, such as a so-called optical sensor or human sensor, and includes control information indicating a detection result of the user located in the vicinity of the projection plane R10. May be generated. Then, the detection unit 13 outputs control information indicating detection results of various states to the control unit 20.

The output unit 30 includes a video output unit 31. The video output unit 31 corresponds to a configuration for projecting a video (that is, a projection unit) in the output unit 30, and is based on control from the control unit 20 described later (at least a part of a desired projection plane ( That is, an image is projected onto the projection area R11) in the projection plane R10. The video output unit 31 is configured to be able to control the direction in which the video is projected and the size of the projected video (in other words, the angle of view).

In the example shown in FIG. 5, the video output unit 31a corresponds to the video output unit 31 of the output unit 30a, and the video output unit 31b corresponds to the video output unit 31 of the output unit 30b.

The control unit 20 includes an image analysis unit 21, an input analysis unit 22, a process execution unit 23, a mode determination unit 25, and an output control unit 26.

The image analysis unit 21 acquires the captured image of the projection plane R10 from the imaging unit 11. The image analysis unit 21 performs an image analysis on the acquired image to detect an operating body such as a user's hand existing on the projection plane R10. Further, the image analysis unit 21 may detect a user located in the vicinity of the projection plane R10 by analyzing the acquired image. Then, the image analysis unit 21 outputs the analysis result of the image of the projection plane R10 (for example, the detection result of the operation body such as the user's hand) to the input analysis unit 22. Further, the image analysis unit 21 may output an analysis result of the image of the projection plane R10 (for example, a detection result of the user, the user's hand, etc.) to the mode determination unit 25 described later.

The input analysis unit 22 acquires the analysis result of the image of the projection plane R10 from the image analysis unit 21. Based on the obtained analysis result, the input analysis unit 22 extracts an operation body such as a user's hand from the image of the projection plane R10. The input analysis unit 22 recognizes the content of the user operation by the operation body based on the extracted movement of the operation body along the time series. At this time, the coordinates of the projection surface R10 on which the display information is projected and the contact coordinates on the projection surface R10 of the operating body such as the user's hand are calibrated in advance, for example, input analysis The unit 22 can detect which part of the projected display information (for example, GUI or the like) the operating body has touched.

Based on the recognized operation content, the input analysis unit 22 recognizes the content of the instruction based on the operation from the user, identifies the target function (for example, application) or content according to the instruction, Control information indicating the content is output to the process execution unit 23.

Further, the input analysis unit 22 may output information indicating the recognized operation content (for example, content indicated by the gesture operation) to the mode determination unit 25.

The process execution unit 23 is configured to execute various functions. The process execution unit 23 acquires control information indicating functions and contents from the input analysis unit 22. The process execution unit 23 reads various data (for example, a library for executing an application and content data) from the storage unit 40 for executing a target function based on the acquired control information. The storage unit 40 is a storage unit that stores various data for the processing execution unit 23 to execute various functions.

And the process execution part 23 performs the function which the acquired control information shows based on the various data read from the memory | storage part 40. FIG.

Note that the process execution unit 23 may output control information indicating the execution result of the function specified based on the operation from the user to the output control unit 26 described later. As a result, the output control unit 26 transmits information indicating the execution result of the function specified based on the operation from the user to at least one of the

output units

30a and 30b (more specifically, the

video output units

31a and 31b). By projecting onto the projection plane R10, the execution result of the function can be presented to the user.

Further, the process execution unit 23 may output various types of information according to the execution of the function specified based on the operation from the user to the mode determination unit 25 described later. As a specific example, when a function related to reproduction of image content such as a still image or a moving image is executed, the process execution unit 23 includes information about the image content (for example, attributes such as resolution and the number of pixels). Information) may be output to the mode determination unit 25. Thereby, the mode determination unit 25 can recognize various information such as the resolution and the number of pixels of the reproduced image content.

The mode determination unit 25 switches the operation mode for controlling the operations of the plurality of output units 30 to one of a plurality of preset operation modes according to various types of input information. As the operation mode, for example, the operation mode for individually controlling the operations of the plurality of output units 30 described with reference to FIG. 3 or the plurality of output units 30 described with reference to FIG. Among these, an operation mode in which at least some of the two or more output units 30 cooperate with each other can be used. Note that another example of an operation mode for the information processing apparatus 1 according to the present embodiment to control operations of the plurality of output units 30 will be separately described later as a modification.

For example, the mode determination unit 25 may determine the operation mode based on the recognition result of the operation by the user. In this case, the mode determination unit 25 acquires information (for example, content indicated by the gesture operation) indicating the recognition result of the operation content by the user from the input analysis unit 22, and according to the operation content indicated by the information. The operation mode may be determined.

In addition, if the user can instruct the operation mode to the information processing apparatus 1, the type of operation for instructing the operation mode is not particularly limited. As a specific example, the information processing apparatus 1 may cause the output unit 30 to project an image on which a UI for designating an operation mode is presented, and determine the operation mode based on an operation from the user with respect to the UI. Good. In this case, the mode determination unit 25 compares the position in the projection plane R10 on which the UI is projected with the position of an operation (for example, a tap operation) performed by the user on the projection plane R10. What is necessary is just to recognize the operation mode designated by the user.

As another example, the mode determination unit 25 may acquire various types of information according to the execution of various functions by the processing execution unit 23, and determine the operation mode based on the information. As a specific example, the mode determination unit 25 acquires information related to reproduced content (for example, attribute information such as resolution and the number of pixels) from the processing execution unit 23, and selects an operation mode based on the acquired information related to content. You may decide. In this case, for example, when the resolution of the reproduced content is higher than the resolution of each output unit 30, the mode determination unit 25 projects each of the two or more output units 30 as shown in FIG. An operation mode in which one display area is formed by combining the areas (that is, an operation mode in which two or more output units 30 are linked) may be selected.

As another example, the mode determination unit 25 may determine an operation mode based on a detection result by the detection unit 13 or an image analysis result by the image analysis unit 21. As a specific example, the mode determination unit 25 recognizes the position and orientation of the user existing around the projection plane R10 based on the detection result by the detection unit 13 and the analysis result of the image by the image analysis unit 21, and The operation mode may be determined according to the recognition result.

As a more specific example, when a plurality of users are detected, the mode determination unit 25 selects an operation mode for individually controlling the operations of the plurality of output units 30 as shown in FIG. May be. In this case, for example, the mode determination unit 25 assigns one of the plurality of output units 30 to each detected user and displays the output unit 30 in the vicinity of the assigned user. The setting information corresponding to the operation mode may be generated so that the information is projected.

At this time, the mode determination unit 25 also assigns the output unit 30 to each user according to the positional relationship between each output unit 30 and each detected user, and the direction in which the output unit 30 projects an image. And the angle of view may be determined. In this case, for example, the mode determination unit 25 prevents the video projected from the output units 30 on the projection plane R10 from being blocked by the detected users (in other words, the output units 30 and the output units). The output unit 30 assigned to each user and the direction and angle of view in which the output unit 30 projects an image may be determined so that the user does not intervene with the projection region R11 corresponding to 30.

As described above, the mode determination unit 25 determines an operation mode for controlling operations of the plurality of output units 30 according to various types of input information, and sends information indicating the determined operation mode to the output control unit 26. Output. At this time, the mode determination unit 25 controls the operation of each output unit 30 in the determined operation mode, according to the setting information corresponding to the operation mode (for example, the direction or image in which each output unit 30 projects an image). Information indicating a corner) may be output to the output control unit 26.

The output control unit 26 is configured to control the operation of the output unit 30 (particularly, the video output unit 31). The output control unit 26 acquires information indicating an operation mode for controlling operations of the plurality of output units 30 from the mode determination unit 25, and operates each output unit 30 according to the operation mode indicated by the acquired information. (For example, the direction in which the image is projected, the angle of view, the content of the image to be projected, etc.)

Also, the output control unit 26 causes each output unit 30 to project display information to be presented to the user according to the determined operation mode. At this time, the output control unit 26 may acquire control information indicating the execution result of the function specified based on the operation from the user from the process execution unit 23. In this case, the output control unit 26 may project the display information indicating the execution result of the function specified based on the operation from the user on each output unit 30 according to the determined operation mode.

As a more specific example, attention is paid to a case where an operation mode for individually controlling the operations of the plurality of output units 30 is selected as shown in FIG. In this case, the output control unit 26 displays, for example, setting information indicating the setting of the direction and angle of view in which each output unit 30 projects an image, which is determined according to the detected position and orientation of the user. Obtained from the determination unit 25. Then, based on the acquired setting information, the output control unit 26 controls the operation of each output unit 30 (for example, the direction and angle of view for projecting the video) and presents the output unit 30 to the target user. Display information (for example, information indicating a result of an operation on a video (display information) projected by the output unit 30) may be projected.

As another example, as shown in FIG. 4, at least a part of two or more output units 30 among a plurality of output units 30 are linked, and projection areas corresponding to the two or more output units 30 are combined. Thus, attention is paid to a case where an operation mode for forming one display area is selected. In this case, the output control unit 26 determines the direction in which each of the two or more output units 30 projects an image so that the projection regions R11 corresponding to the two or more output units 30 to be linked to each other are coupled to each other. Control the angle of view. Further, the output control unit 26 divides the video (display information) to be projected into a plurality of partial images according to the coupling relationship between the projection regions R11 corresponding to each of the two or more output units 30, and is divided. The partial image may be output to the output unit 30 corresponding to each projection region R11.

The example of the functional configuration of the information processing apparatus 1 according to the present embodiment has been described above with reference to FIG. The configuration illustrated in FIG. 5 is merely an example, and the functional configuration of the information processing device 1 is not necessarily limited to the example illustrated in FIG. 5 as long as the various operations of the information processing device 1 described above can be realized. As a specific example, at least one of the input unit 10 and the plurality of output units 30 may be externally attached to the information processing device 1 as an external device different from the information processing device 1. . As another example, at least a part of the configuration of the control unit 20 may be provided in an external device (for example, a server connected via a network) different from the information processing device 1.

<3. Processing>
Next, with reference to FIG. 6, regarding an example of a flow of a series of processes of the information processing apparatus 1 according to the present embodiment, in particular, the information processing apparatus 1 determines an operation mode, and according to the determined operation mode. Description will be made focusing on the operation of projecting an image on the projection surface R10. FIG. 6 is a flowchart illustrating an example of a flow of a series of operations of the information processing apparatus 1 according to the present embodiment.

(Steps S101 and S103)
First, the information processing apparatus 1 analyzes various input information (step S101), and determines an operation mode for controlling the operations of the plurality of output units 30 based on the analysis result (step S103).

As a specific example, the mode determination unit 25 may determine the operation mode based on the recognition result of the operation by the user. In this case, the image analysis unit 21 acquires the image of the projection plane R10 acquired from the imaging unit 11, and performs image analysis on the image, thereby allowing the user's hand, etc., present on the projection plane R10 to exist. Detect the operating body. Then, the image analysis unit 21 outputs the analysis result of the image of the projection plane R10 (for example, the detection result of the operation body such as the user's hand) to the input analysis unit 22.

The input analysis unit 22 acquires the analysis result of the image of the projection plane R10 from the image analysis unit 21, and recognizes the content of the user operation (for example, the content of the gesture operation by an operating body such as a hand) based on the analysis result. To do. And the input analysis part 22 outputs the information (for example, the content which gesture operation shows) which shows the recognized operation content to the mode determination part 25 (step S101).

In this case, the mode determination unit 25 acquires information indicating the recognition result of the content of the operation by the user from the input analysis unit 22, and determines the operation mode according to the operation content indicated by the information (step S103).

As another example, the mode determination unit 25 acquires information (for example, attribute information such as resolution and the number of pixels) regarding the reproduced content from the processing execution unit 23, and based on the acquired information about the content, the operation mode May be determined. In this case, for example, when the resolution of the reproduced content is higher than the resolution of each output unit 30 (step S101), the mode determination unit 25, as shown in FIG. An operation mode for forming one display area by combining the 30 projection areas (that is, an operation mode for linking two or more output units 30) may be selected (step S103).

As described above, the mode determination unit 25 determines an operation mode for controlling operations of the plurality of output units 30 according to various types of input information, and sends information indicating the determined operation mode to the output control unit 26. Output.

(Step S105)
The output control unit 26 acquires information indicating an operation mode for controlling operations of the plurality of output units 30 from the mode determination unit 25, and operates each output unit 30 according to the operation mode indicated by the acquired information. (For example, the direction in which the image is projected, the angle of view, the content of the image to be projected, etc.) are controlled.

(Step S107)
Then, the output control unit 26 projects display information to be presented to the user on each output unit 30 according to the determined operation mode. At this time, the output control unit 26 acquires the control information indicating the execution result of the function specified based on the operation from the user from the process execution unit 23, and the display information indicating the execution result based on the control information. May be projected on each output unit 30 according to the determined operation mode.

As described above, with reference to FIG. 6, with respect to an example of a series of processing flows of the information processing apparatus 1 according to the present embodiment, in particular, the information processing apparatus 1 determines an operation mode and projects according to the determined operation mode. Description has been given focusing on the operation of projecting an image on the surface R10.

<4. Modification>
Next, as a modification of the information processing apparatus 1 according to the present embodiment, an example of control when the information processing apparatus 1 causes at least some of the two or more output units 30 among the plurality of output units 30 to cooperate with each other. Will be described.

[4.1. Modification Example 1: Control Example for Projecting High Frame Rate Video]
First, as a first modification example, information in the case of realizing the projection of a moving image at a higher frame rate than the frame rate based on the performance of each output unit 30 by linking two or more output units 30 together. An example of the operation of the processing apparatus 1 will be described.

In the information processing apparatus 1 according to the first modification, each output unit 30 projects a direction or image so that the projection regions R11 of the two or more output units 30 linked to each other overlap on the projection plane R10. Adjust the corners. In this description, the information processing apparatus 1 is described as one in which the

output units

30a and 30b cooperate with each other as the two or more output units 30.

For example, FIG. 7 is an explanatory diagram for explaining the outline of the operation of the information processing apparatus 1 according to the first modification. On the projection plane R10, the projection region R11a corresponding to the output unit 30a and the output unit 30b An example of a state in which the corresponding projection region R11b is superimposed is shown.

The information processing apparatus 1 controls the operation of the output unit 30 so that two or more output units 30 (for example, the

output units

30a and 30b) to be linked with each other project images at different timings.

For example, FIG. 8 is an explanatory diagram for explaining an outline of the operation of the information processing apparatus 1 according to the first modification. In the example illustrated in FIG. 8, the information processing apparatus 1 causes the

output units

30 a and 30 b to cooperate with each other so that a moving image with a higher frame rate than the frame rate based on the performance of each of the

output units

30 a and 30 b. Projection is realized.

Specifically, the reference signs F10a to F12a and F10b to F12b schematically show each frame of the moving image to be projected. Further, the horizontal direction in FIG. 8 indicates time t. That is, FIG. 8 schematically shows the order in which the frames F10a to F12a and F10b to F12b of the moving image to be projected are projected.

Here, in the information processing apparatus 1 according to the modification 1, the frames F10a to F12a are projected on the output unit 30a from the series of frames F10a to F12a and F10b to F12b illustrated in FIG. 8, and the frames F10b to F12b are output. Projected onto the unit 30b.

That is, the information processing apparatus 1 first causes the output unit 30a to project the frame F10a onto the projection region R11, and then causes the output unit 30b to project the frame F10b onto the projection region R11. After the frame F10b is projected, the information processing apparatus 1 causes the output unit 30a to project the frame F11a onto the projection region R11, and then causes the output unit 30b to project the frame F11b onto the projection region R11.

As described above, the information processing apparatus 1 superimposes the projection regions R11 of the

output units

30a and 30b, and alternately displays the frames of the moving image to be projected on the

output units

30a and 30b in time series. Projecting. With such a configuration, the information processing apparatus 1 according to Modification 1 can project a moving image at a frame rate higher than the frame rate based on the performance of each output unit 30.

Note that the information processing apparatus 1 realizes the high frame rate described above when, for example, a moving image having a higher frame rate than the frame rate based on the performance of each output unit 30 is a projection target. The operation of each output unit 30 may be controlled based on the operation mode.

As described above, as Modification 1, with reference to FIGS. 7 and 8, a movie with a higher frame rate than the frame rate based on the performance of each of the output units 30 by linking two or more output units 30 together. An example of the operation of the information processing apparatus 1 for realizing image projection has been described.

[4.2. Modification Example 2: Control Example 1 for Projecting a High Quality Video]
Next, as a second modification, the information processing apparatus 1 for realizing projection of an image with higher image quality than an image that can be projected by each of the output units 30 by linking two or more output units 30 together. An example of the operation will be described. In this description, the information processing apparatus 1 will be described assuming that the

output units

30a and 30b cooperate with each other.

For example, the information processing apparatus 1 according to the modified example 2 may realize projection of an image with a wider dynamic range by causing the

output units

30a and 30b to cooperate with each other.

Specifically, as illustrated in FIG. 7, the information processing apparatus 1 includes the

output units

30 a and 30 b so that the projection regions R 11 (that is, the projection regions R 11 a and R 11 b) corresponding to the

output units

30 a and 30 b overlap each other. The operation of 30b is controlled.

Note that at this time, images are projected from the

output units

30a and 30b, respectively, in the region where the projection regions R11a and R11b overlap, and the images overlap. Therefore, the gradation of the image projected on the region where the projection regions R11a and R11b overlap is obtained by adding the gradation of the image projected from the output unit 30a and the gradation of the image projected from the output unit 30b. Become.

That is, the information processing apparatus 1 individually controls the light amount (for example, luminance) of the light emitted from the light sources of the

output units

30a and 30b, so that each output unit 30 can be individually realized from the dynamic range. However, it is possible to project an image expressed in a wider dynamic range.

Note that, for example, when an image expressed in a wider dynamic range than the dynamic range that can be individually realized by each output unit 30 is a projection target, the information processing apparatus 1 performs the wide dynamic described above. You may control operation | movement of each output part 30 based on the operation mode for implement | achieving the expression in a range.

As another example, the information processing apparatus 1 according to the second modification may realize an image projection with a wider color gamut by causing the

output units

30a and 30b to cooperate with each other.

Specifically, as illustrated in FIG. 7, the information processing apparatus 1 includes the output units 30 a and 30 so that the projection regions R 11 (that is, the projection regions R 11 a and R 11 b) corresponding to the output units 30 a and 30 overlap each other. The operation of 30b is controlled.

Then, the information processing apparatus 1 outputs the light from the light sources of the

output units

30a and 30b (that is, from the light source) so that the color gamuts of the light emitted from the

output units

30a and 30b are different from each other. The emitted light) is controlled. The method is not particularly limited as long as the color gamut of light emitted from each of the

output units

30a and 30b can be controlled. As a specific example, the information processing apparatus 1 may control the color gamut of light emitted from the output unit 30 by controlling the output of the light source. As another example, the information processing apparatus 1 controls the optical system (for example, a filter or the like) that passes through before the light emitted from the light source is emitted to the outside of the output unit 30, so that the output unit 30. You may control the color gamut of the light radiate | emitted from.

By such control, images expressed in different color gamuts are projected from the

output units

30a and 30b and superimposed on the projection plane R10. With such a configuration, the information processing apparatus 1 according to Modification 2 can project an image expressed in a wider color gamut than the color gamut that each output unit 30 can individually express.

For example, when an image expressed in a wider color gamut than the color gamut that can be individually expressed by each output unit 30 is a projection target, the information processing apparatus 1 uses the wide color described above. The operation of each output unit 30 may be controlled based on the operation mode for realizing the expression in the area.

[4.3. Modification 3: Control Example 2 for Projecting High-Quality Video]
Next, as a third modification, an example of the operation of the information processing apparatus 1 for realizing projection of an image with a higher resolution than the resolution of each output unit 30 will be described.

For example, FIG. 9 is an explanatory diagram for explaining an example of the operation of the information processing apparatus 1 according to the modified example 3. By projecting the

output units

30a and 30b to each other, an image with a higher resolution is realized. An example of the case is shown. FIG. 9 schematically shows the positional relationship of each pixel of the image projected on the projection plane R10 from each of the

output units

30a and 30b.

In FIG. 9, reference symbol R13a schematically shows pixels of an image projected on the projection plane R10 by the output unit 30a (that is, video pixels projected on the projection region R11a). Similarly, the reference symbol R13b schematically indicates pixels of an image projected on the projection plane R10 by the output unit 30b (that is, pixels of an image projected on the projection region R11b).

That is, in the example shown in FIG. 9, the information processing apparatus 1 determines that the difference between the position of the projection region R11a corresponding to the output unit 30a and the position of the projection region R11b corresponding to the output unit 30b is a half-pixel unit ( Alternatively, the position of each projection region R11 is adjusted so as to be in subpixel units.

Under such control, the information processing apparatus 1 superimposes the images projected from the

output units

30a and 30b on the projection plane R10, so that an image having a higher resolution than the resolution of each output unit 30 ( For example, in the case of the example shown in FIG. 9, it is possible to simulate the projection of an image having a resolution of 4 times.

The information processing apparatus 1 may generate the pixel R13a projected by the output unit 30a and the pixel R13b projected by the output unit 30b based on each pixel in the image to be projected. As a specific example, the information processing apparatus 1 sets the pixel R13a projected by the output unit 30a to a pixel in a region corresponding to the pixel R13a in the image to be projected or a pixel located in the vicinity of the region. You may generate based on. The same applies to the pixel R13b projected by the output unit 30b.

Further, as shown in FIG. 9, the information processing apparatus 1 may, for example, describe “Niranjan Damera-Venkata and Nelson L. Chang” as an example of various filter processes for generating images projected by the

output units

30a and 30b. , “Realizing Super-Resolution with Superimposed Projection,” IEEE International Workshop on Projector-Camera Systems IV (ProCams), 18 June 2007, Minneapolis, MN.

Further, the control shown in FIG. 9 can be realized by a single output unit 30. In this case, for example, the information processing apparatus 1 may project the pixel R13a projected onto the projection region R11a and the pixel R13b projected onto the projection region R11b in a time division manner.

FIG. 10 is an explanatory diagram for explaining another example of the operation of the information processing apparatus 1 according to the modified example 3. The method is different from the control shown in FIG. 2 shows an example of control for realizing projection of an image with a higher resolution.

In the example illustrated in FIG. 10, the image to be projected is divided into a plurality of partial images, and each partial image is projected in a time division manner, thereby projecting an image with a higher resolution than the resolution of each output unit 30. Realized. Specifically, in the example illustrated in FIG. 10, the reference symbol R <b> 20 schematically indicates a range in which a video to be projected is projected. Reference numerals R111 to R114 schematically indicate projection areas in which video is projected by the output unit 30 in a time division manner.

That is, in the example shown in FIG. 10, the information processing apparatus 1 divides an image to be projected into four partial images, and sequentially projects the corresponding partial images on the projection regions R111 to R114 in time division. In this way, the operation of the output unit 30 (for example, the projection direction, the angle of view, and the partial image to be projected) is controlled.

As described above, the so-called projector can control the size of the image projected on the projection plane R10 by controlling the angle of view, and even when the size of the image is changed. The resolution of the video does not change. For this reason, when the angle of view is further reduced and the size of the image is controlled to be smaller, the size of each pixel in the projected image becomes smaller and the interval between the pixels becomes shorter. In the example illustrated in FIG. 10, the information processing apparatus 1 outputs the video to be projected by projecting each partial image with the resolution of the output unit 30 in a time division manner using the characteristics of the projector described above. The image is projected at a higher resolution than the resolution of the unit 30 (that is, four times higher resolution).

Note that the control shown in FIG. 10 may be realized by control of a single output unit 30, or may be realized by linking two or more output units 30 to each other. When two or more output units 30 are linked to each other, the information processing apparatus 1 causes each output unit 30 to project different partial images (that is, not to project the same partial image at the same timing). B) The operation of the output unit 30 may be controlled.

Note that the information processing apparatus 1 combines the control illustrated in FIG. 9 and the control illustrated in FIG. 10 in which at least two or more output units 30 cooperate with each other, so that the resolution is higher than the resolution of each output unit 30. Projection of the image may be realized.

In addition, the information processing apparatus 1 is described above with reference to FIGS. 9 and 10 when an image expressed by each output unit 30 with a higher resolution than the resolution is a projection target. The operation of each output unit 30 may be controlled based on the operation mode for realizing the high-resolution expression.

As described above, as Modification 3, an example of the operation of the information processing apparatus 1 for realizing projection of an image with a resolution higher than the resolution of each output unit 30 has been described with reference to FIGS. 9 and 10. .

Needless to say, the controls of the information processing apparatus 1 described as the first to third modifications may be appropriately combined. As a specific example, the information processing apparatus 1 realizes the control for realizing the expression in a wider color gamut described as the modification 2 and the expression with the higher resolution described as the modification 3. For this reason, it is possible to realize the projection of a higher quality image by combining with the control for this purpose. As another example, the information processing apparatus 1 realizes the control described in the first modification for realizing the expression at a higher frame rate and the expression in the higher resolution described as the third modification. You may combine with the control for doing. In addition, when combining each control demonstrated above, it cannot be overemphasized that the number of the output parts 30 used as cooperation object may be adjusted suitably.

[4.4. Modified Example 4: Control Example for Realizing Partially High Image Quality]
As described above, so-called projectors project a larger image to be projected, the larger the size of each pixel in the projected image and the longer the interval between pixels. On the other hand, the smaller the video to be projected, the smaller the size of each pixel in the projected video and the shorter the spacing between pixels. In the information processing apparatus 1 according to the modified example 4, by utilizing such characteristics, two or more output units 30 are linked to each other, so that a part of a series of images (for example, operation screens) to be projected is included. The partial image (for example, the portion where the specific content is displayed) is improved in image quality (that is, partially improved in image quality). Hereinafter, an example of the operation of the information processing apparatus 1 according to Modification 4 will be described.

For example, FIG. 11 is an explanatory diagram for explaining an example of the operation of the information processing apparatus 1 according to the modification 4. In this description, it is assumed that the information processing apparatus 1 causes the

output units

30a and 30b to cooperate with each other. In FIG. 11, reference sign R11a indicates a projection region R11 corresponding to the output unit 30a. Reference numeral R11b indicates a projection region R11 corresponding to the output unit 30b.

In the example illustrated in FIG. 11, for example, the information processing apparatus 1 is projecting an operation screen for operating the information processing apparatus 1 on the projection surface R <b> 10 on the top surface of the table 140. In FIG. 11, a reference sign V11 schematically indicates a display object (for example, a window displayed based on the reproduction of content) presented in the operation screen. That is, the information processing apparatus 1 projects the entire operation screen toward the projection area R11b, and projects a partial area (partial image) on which the display object V11 is presented in the operation screen onto the projection area R11a. The image is superimposed on the operation screen projected on the projection region R11b.

Specifically, the information processing apparatus 1 controls the projection region R11b to be formed over the entire projection surface R10 by widening the angle of view of the output unit 30b. The entire operation screen is projected on the output unit 30b. In addition, the information processing apparatus 1 superimposes the projection region R11a on a partial region of the projection region R11b by controlling the angle of view and the projection direction for the output unit 30a. Then, the information processing apparatus 1 presents an image (that is, the display object V11) of a partial area of the operation screen corresponding to the area indicated by the projection area R11a in the operation screen projected on the projection area R11b. The partial image) is projected on the output unit 30a.

By such control, the information processing apparatus 1 can partially express the resolution of the area where the display object V11 is presented at a higher resolution than the entire operation screen projected on the projection area R11b. .

In the example shown in FIG. 11, the position and size of the projection region R11a formed in the projection region R11b may be switched dynamically. As a specific example, when the position or size of the display object V in the operation screen is changed based on an operation from the user U, the information processing apparatus 1 changes the position of the projection region R11a in accordance with the change. You may change the size.

As described above, as Modification 4, with reference to FIG. 11, two or more output units 30 are linked to each other, thereby realizing high image quality for some partial images in a series of images to be projected. Therefore, an example of the operation of the information processing apparatus 1 has been described.

[4.5. Modified Example 5: Control Example for Improving Followability when Changing Display Mode]
Next, as a fifth modification example, an example of control in a case where a display mode such as a position and a size at which the image is projected is changed in a situation where the image is projected onto a part of the projection surface R10. This will be described with reference to FIGS. 12 to 14 are explanatory diagrams for explaining an example of the operation of the information processing apparatus 1 according to the modified example 5, and the position of an image (for example, the display object V11) projected on a part of the projection plane R10. In the case of changing the size (that is, the display mode), an example of control for obtaining more suitable followability is shown.

For example, in the example illustrated in FIG. 12, the information processing apparatus 1 controls the projection area R11a to be smaller by narrowing the angle of view of the output unit 30a, and the display object V11 is displayed in the projection area R11a. The presented image is projected. That is, in the example illustrated in FIG. 12, the information processing apparatus 1 causes a part of the projection surface R10 to be a projection region R11a and causes the output unit 30a to project the video on which the display object V11 is presented toward the projection region R11a. ing. In this way, the display object V11 is presented by projecting the video only to the limited area of the projection area R11a, so that the resolution is higher than when the video is projected over the entire projection plane R10. The display object V11 is presented on the projection plane R10.

Here, in the state shown in FIG. 12, it is assumed that the position of the display object V11 is changed by the operation of the user U and the display object V11 is moved out of the projection region R11a. At this time, when changing the position and size of the projection region R11a, the angle of view of the output unit 30a (particularly the video output unit 31 corresponding to the projector) and the direction in which the video is projected are controlled. Drive is involved. Therefore, for example, when the position and size of the display object V are changed in accordance with the operation of the user U, suitable followability is not always obtained depending on the performance of the output unit 30a.

Therefore, when the information processing apparatus 1 according to the modified example 5 recognizes that the position and size of the display object V11 are changed by the operation of the user U as illustrated in FIG. 13, the projection region R11a by the output unit 30a. The projection of the video on the screen is temporarily stopped, and instead, the video is projected on the output unit 30b.

For example, the reference symbol R11b shown in FIG. 13 indicates the projection region R11 corresponding to the output unit 30b. As illustrated in FIG. 13, the information processing apparatus 1 allows the angle of view of the output unit 30b so that the projection region R11b is a wider region including the projection region R11a (for example, a region corresponding to the entire projection surface R10). The output unit 30b controls the direction in which the image is projected.

Also, the information processing apparatus 1 projects the image projected on the projection area R11a onto the area corresponding to the projection area R11a in the projection area R11b (that is, the area where the display object V11 is displayed). In addition, the image projected by the output unit 30b is controlled. That is, as shown in FIG. 13, the information processing apparatus 1 has the display object V11 with the same size and the same size as in the example shown in FIG. 12 even when switching to the state in which the image is projected onto the projection region R11b. The video output by the output unit 30b is controlled so as to be projected.

Then, the information processing apparatus 1 controls the display position of the display object V11 in the image projected on the projection region R11b based on the operation content of the user U. At this time, the information processing apparatus 1 controls the display position of the display object V11 based on the image processing, so that the position where the display object V11 is projected on the projection surface R10 without mechanical drive is determined. I have control. Therefore, during the control illustrated in FIG. 15, although the resolution of the display object V11 temporarily decreases, the control of the position where the display object V11 is projected is followed in a more preferable manner with respect to the operation by the user U. (That is, the response can be improved).

Next, refer to FIG. FIG. 14 shows a state in which the operation for moving the display object V11 by the user U is completed.

When the information processing apparatus 1 recognizes the completion of the operation of moving the display object V11 by the user U, as illustrated in FIG. 14, the output unit 30a so that the position where the display object V11 is displayed becomes the projection region R11a. Controls the direction in which the image is projected. Then, the information processing apparatus 1 restarts the projection of the image on which the display object V11 is presented on the output unit 30a. At this time, the information processing apparatus 1 may stop the projection of the video onto the projection region R11b by the output unit 30b.

By the control as described above, the display object V11 is presented again on the projection surface R10 with a higher resolution than when the video is projected over the entire projection surface R10. In the example described above, the case where the information processing apparatus 1 controls the position of the display object V11 based on the operation content of the user U has been described, but the case where the size of the display object V11 is controlled is also described. It goes without saying that the same applies.

As described above with reference to FIGS. 12 to 14, the information processing apparatus 1 according to the modified example 5 has a wider projection region R11 when the display mode such as the position and size of the display object V11 is changed. An image is projected on the set output unit 30. Then, the information processing apparatus 1 controls the position and size of the display object V11 based on image processing, so that the display object V11 is projected on the projection plane R10 without any mechanical drive. Control the size. Such control temporarily reduces the resolution of the display object V11, but controls the display mode such as the position and size at which the display object V11 is projected in a more preferable mode for the operation by the user U. Can be made to follow.

In the examples shown in FIGS. 12 to 14, when the information processing apparatus 1 does not recognize the operation by the user U (for example, the state shown in FIGS. 12 and 14), the image is projected onto the projection region R11b. However, it is not necessarily limited to the same mode.

As a specific example, the information processing apparatus 1 does not recognize the operation by the user U as in the information processing apparatus 1 (see FIG. 11) according to the above-described modification 4, and thus the projection region R11b (that is, A video (for example, the entire operation screen) may be projected onto a projection area R11 that includes the projection area R11a and is wider than the projection area R11a. In this case, the information processing apparatus 1 projects an image on both the projection areas R11a and R11b when the operation by the user U is not recognized, and the projection area when the operation by the user U is recognized. It is only necessary to project an image on R11b.

<5. Hardware configuration>
Next, an example of a hardware configuration of the information processing apparatus 1 according to an embodiment of the present disclosure will be described with reference to FIG. FIG. 15 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 1 according to an embodiment of the present disclosure.

As illustrated in FIG. 15, the information processing apparatus 1 according to the present embodiment includes a processor 901, a memory 903, a storage 905, an operation device 907, a notification device 909, a detection device 911, an imaging device 913, Bus 917. Further, the information processing apparatus 1 may include a communication device 915.

The processor 901 may be, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or a SoC (System on Chip), and executes various processes of the information processing apparatus 1. The processor 901 can be configured by, for example, an electronic circuit for executing various arithmetic processes. Each configuration of the control unit 20 described above can be realized by the processor 901.

The memory 903 includes RAM (Random Access Memory) and ROM (Read Only Memory), and stores programs and data executed by the processor 901. The storage 905 can include a storage medium such as a semiconductor memory or a hard disk. For example, the storage unit 40 described above can be realized by at least one of the memory 903 and the storage 905, or a combination of both.

The operation device 907 has a function of generating an input signal for a user to perform a desired operation. The operation device 907 can be configured as a touch panel, for example. As another example, the operation device 907 generates an input signal based on an input by the user, such as buttons, switches, and a keyboard, and an input for the user to input information, and supplies the input signal to the processor 901. It may be composed of a control circuit or the like.

The notification device 909 is an example of an output device. For example, the information may be notified to the user by projecting predetermined information onto a projection surface like a so-called projector. Note that the output unit 30 described above can be realized by the notification device 909.

Further, the notification device 909 may be a device such as a liquid crystal display (LCD) device or an organic EL (Organic Light Emitting Diode) display. In this case, the notification device 909 can notify the user of predetermined information by displaying the screen.

Further, the notification device 909 may be a device that notifies a user of predetermined information by outputting a predetermined acoustic signal, such as a speaker.

In addition, the example of the notification device 909 described above is merely an example, and the aspect of the notification device 909 is not particularly limited as long as predetermined information can be notified to the user. As a specific example, the notification device 909 may be a device that notifies the user of predetermined information using a lighting or blinking pattern, such as an LED (Light Emitting Diode).

The imaging device 913 includes an imaging element that captures a subject and obtains digital data of the captured image, such as a CMOS (Complementary Metal-Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor. That is, the imaging device 913 has a function of capturing a still image or a moving image via an optical system such as a lens in accordance with the control of the processor 901. The imaging device 913 may store the captured image in the memory 903 or the storage 905. The imaging unit 11 described above can be realized by the imaging device 913.

The detection device 911 is a device for detecting various states. The detection device 911 can be configured by a so-called distance measuring sensor such as a stereo image sensor. Further, the detection device 911 may be configured by a sensor for detecting a predetermined target, such as a so-called optical sensor. The detection unit 13 described above can be realized by the detection device 911.

The communication device 915 is a communication unit included in the information processing apparatus 1 and communicates with an external device via a network. The communication device 915 is a wired or wireless communication interface. When the communication device 915 is configured as a wireless communication interface, the communication device 915 may include a communication antenna, an RF (Radio Frequency) circuit, a baseband processor, and the like.

The communication device 915 has a function of performing various kinds of signal processing on a signal received from an external device, and can supply a digital signal generated from the received analog signal to the processor 901.

The bus 917 connects the processor 901, the memory 903, the storage 905, the operation device 907, the notification device 909, the detection device 911, the imaging device 913, and the communication device 915 to each other. The bus 917 may include a plurality of types of buses.

In addition, it is possible to create a program for causing hardware such as a processor, memory, and storage built in the computer to perform the same functions as the configuration of the information processing apparatus 1 described above. A computer-readable storage medium that records the program can also be provided.

<6. Summary>
As described above, the information processing apparatus 1 according to an embodiment of the present disclosure selectively selects a plurality of operation modes having different modes for superimposing the projection regions R11 corresponding to the plurality of output units 30, respectively. It is configured to be switchable. In other words, at least a part of the plurality of operation modes that the information processing apparatus 1 is a switching target includes an operation mode in which at least two or more output units 30 among the plurality of output units 30 cooperate with each other. In addition, at least a part of the plurality of operation modes to be switched by the information processing apparatus 1 is an operation mode for individually controlling the operation of at least some of the output units 30 among the plurality of output units 30. May be included.

With such a configuration, the information processing apparatus 1 according to an embodiment of the present disclosure is configured according to the usage scene of the information processing apparatus 1 (that is, usage usage, usage mode, content to be projected, and the like). The output unit 30 can project an image in a more preferable manner.

Note that the plurality of output units 30 to be controlled by the information processing apparatus 1 are not necessarily required to have the same performance, and may have different characteristics. In this case, the information processing apparatus 1 uses the output unit 30 that is more suitable for the selected operation mode (in other words, more suitable for the use scene) as a control target in the operation mode according to the performance of each output unit 30. You may choose. Further, by configuring each output unit 30 to be detachable with respect to the information processing apparatus 1, the number of output units 30 to be controlled by the information processing apparatus 1 may be appropriately changed. In this case, the information processing apparatus 1 dynamically switches the operation mode candidates to be selected according to the number of output units 30 recognized as control targets and the performance of each output unit 30. Also good.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A control unit that controls operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
The controller selectively switches a plurality of operation modes different from each other in a mode for superimposing the projection regions corresponding to each of at least two or more of the plurality of projection units.
Information processing device.
(2)
The information processing apparatus according to (1), wherein the control unit selectively switches the operation mode according to information associated with the display information to be displayed.
(3)
The information processing apparatus according to (1) or (2), wherein the control unit selectively switches the operation mode according to control information indicating the acquired user operation content.
(4)
The information processing apparatus according to any one of (1) to (3), wherein the control unit selectively switches the operation mode according to a detection result of an external environment.
(5)
The control unit, in at least some of the plurality of operation modes, combines the projection regions corresponding to two or more projection units to form one display region, and the display region includes the display region. The information processing apparatus according to any one of (1) to (4), wherein display information is projected.
(6)
The control unit controls, in at least some of the plurality of operation modes, operations of the two or more projection units in which the projection regions are superimposed on each other in a different manner from each other (1 The information processing apparatus according to any one of (5) to (5).
(7)
The information processing apparatus according to (6), wherein the control unit causes the display information controlled to have different color gamuts to be projected onto each of the two or more projection units in which the projection regions are superimposed on each other. .
(8)
The control unit controls the dynamic range of the display information projected on the projection region by individually controlling the luminance of each of the two or more projection units obtained by superimposing the projection regions on each other, (6 ).
(9)
The control unit according to (6), wherein the control unit controls the operation of each of the two or more projection units such that a difference between projection positions of the plurality of projection regions superimposed on each other is in sub-pixel units. Information processing device.
(10)
The information processing apparatus according to (6), wherein the control unit causes the two or more projection units that overlap the projection regions to project the display information at different timings.
(11)
The control unit corresponds to a plurality of partial images in which the display information is divided in at least some of the projection units in the projection region in at least some of the plurality of operation modes. The information processing apparatus according to any one of (1) to (10), wherein the information is projected onto the partial area in a time division manner.
(12)
The control unit performs the first projection on a first projection region corresponding to the first projection unit among the plurality of projection units in at least some of the plurality of operation modes. The second projection area corresponding to the second projection unit, in which a part of the display information projected on the area is displayed, is superimposed, according to any one of (1) to (11). Information processing device.
(13)
The controller is
In at least some of the plurality of operation modes,
When controlling the display mode of the first display information projected on the first projection area corresponding to the first projection unit among the plurality of projection units,
Instead of the first projecting unit, the second projecting unit projects the second display information on which the first display information is presented on the second projecting region including the first projecting region. Let
Controlling the display mode of the first display information in the second display information,
The information processing apparatus according to any one of (1) to (12).
(14)
Processor
Controlling the operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
A mode for superimposing the projection regions corresponding to each of at least two of the plurality of projection units among the plurality of projection units selectively switching a plurality of operation modes different from each other;
Including an information processing method.
(15)
On the computer,
Controlling the operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
A mode for superimposing the projection regions corresponding to each of at least two of the plurality of projection units among the plurality of projection units selectively switching a plurality of operation modes different from each other;
A program that executes

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 10 Input part 11 Imaging part 13 Detection part 20 Control part 21 Image analysis part 22 Input analysis part 23 Process execution part 25 Mode determination part 26 Output control part 30 Output part 31 Video | video output part 40 Storage part

Claims

A control unit that controls operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
The controller selectively switches a plurality of operation modes different from each other in a mode for superimposing the projection regions corresponding to each of at least two or more of the plurality of projection units.
Information processing device.
The information processing apparatus according to claim 1, wherein the control unit selectively switches the operation mode in accordance with information associated with the display information to be displayed.
The information processing apparatus according to claim 1, wherein the control unit selectively switches the operation mode according to control information indicating the acquired user operation content.
The information processing apparatus according to claim 1, wherein the control unit selectively switches the operation mode according to a detection result of an external environment.
The control unit, in at least some of the plurality of operation modes, combines the projection regions corresponding to two or more projection units to form one display region, and the display region includes the display region. The information processing apparatus according to claim 1, wherein display information is projected.
The control unit controls, in at least some of the plurality of operation modes, operations of the two or more projection units in which the projection regions are superimposed on each other in different modes. The information processing apparatus described in 1.
The information processing apparatus according to claim 6, wherein the control unit projects the display information controlled to have different color gamuts onto each of the two or more projection units in which the projection regions are superimposed on each other.
The said control part controls the dynamic range of the said display information projected on the said projection area | region by controlling separately the brightness | luminance of each of the two or more said projection parts which overlapped the said projection area | region mutually. The information processing apparatus described in 1.
The information according to claim 6, wherein the control unit controls operations of the two or more projection units such that a difference between projection positions of the plurality of projection regions superimposed on each other is in sub-pixel units. Processing equipment.
The information processing apparatus according to claim 6, wherein the control unit causes the display information to be projected at different timings to each of the two or more projection units in which the projection areas are superimposed on each other.
The control unit corresponds to a plurality of partial images in which the display information is divided in at least some of the projection units in the projection region in at least some of the plurality of operation modes. The information processing apparatus according to claim 1, wherein the information processing apparatus projects the partial area in a time division manner.
The control unit performs the first projection on a first projection region corresponding to the first projection unit among the plurality of projection units in at least some of the plurality of operation modes. The information processing apparatus according to claim 1, wherein a second projection area corresponding to a second projection unit on which a part of the display information projected on the area is displayed is superimposed.
The controller is
In at least some of the plurality of operation modes,
When controlling the display mode of the first display information projected on the first projection area corresponding to the first projection unit among the plurality of projection units,
Instead of the first projecting unit, the second projecting unit projects the second display information on which the first display information is presented on the second projecting region including the first projecting region. Let
Controlling the display mode of the first display information in the second display information,
The information processing apparatus according to claim 1.
Processor
Controlling the operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
A mode for superimposing the projection regions corresponding to each of at least two of the plurality of projection units among the plurality of projection units selectively switching a plurality of operation modes different from each other;
Including an information processing method.
On the computer,
Controlling the operations of a plurality of projection units that display the display information by projecting the display information onto at least a part of the projection area in the projection plane;
A mode for superimposing the projection regions corresponding to each of at least two of the plurality of projection units among the plurality of projection units selectively switching a plurality of operation modes different from each other;
A program that executes