US9918058B2 - Information processing to allow projector units to project images in cooperation - Google Patents

Information processing to allow projector units to project images in cooperation Download PDF

Info

Publication number
US9918058B2
US9918058B2 US15/319,085 US201515319085A US9918058B2 US 9918058 B2 US9918058 B2 US 9918058B2 US 201515319085 A US201515319085 A US 201515319085A US 9918058 B2 US9918058 B2 US 9918058B2
Authority
US
United States
Prior art keywords
information
group
information processing
projection
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/319,085
Other languages
English (en)
Other versions
US20170127032A1 (en
Inventor
Naomasa Takahashi
Naoki Kobayashi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Assigned to SONY CORPORATION reassignment SONY CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOBAYASHI, NAOKI, TAKAHASHI, NAOMASA
Publication of US20170127032A1 publication Critical patent/US20170127032A1/en
Application granted granted Critical
Publication of US9918058B2 publication Critical patent/US9918058B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3188—Scale or resolution adjustment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2003—Display of colours
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N5/225—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3129—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] scanning a light beam on the display screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/3147—Multi-projection systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3182—Colour adjustment, e.g. white balance, shading or gamut
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2300/00—Aspects of the constitution of display devices
    • G09G2300/02—Composition of display devices
    • G09G2300/026—Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00—Control of display operating conditions
    • G09G2320/06—Adjustment of display parameters
    • G09G2320/0666—Adjustment of display parameters for control of colour parameters, e.g. colour temperature
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2352/00—Parallel handling of streams of display data
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2356/00—Detection of the display position w.r.t. other display screens
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G09G2370/025—LAN communication management
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/16—Use of wireless transmission of display information

Definitions

  • the present technology relates to an information processing apparatus and method, particularly to an information processing apparatus and method that allow a plurality of projection units to project images more easily in cooperation.
  • Non-Patent Document 1 there have been systems that use a plurality of projectors to project images (for example, refer to Non-Patent Document 1).
  • the plurality of projectors connected to a computer is controlled and driven by the computer to cooperate with one another and project one or more images. That is, the computer causes the plurality of projectors to cooperate with one another.
  • this method requires, besides the projectors, the computer for controlling, a camera for sensing, complicated programs for executing system operations, operators with technical knowledge, and others. It suits expensive and large-scaled systems but does not suit simple and less expensive systems that general users without expertise can enjoy casually.
  • the present technology is proposed in light of the foregoing circumstances, and an object of the present technology is to allow a plurality of projection units to project images more easily in cooperation.
  • One aspect of the present technology is an information processing apparatus including: a group formation unit that forms a group for projecting one contents data in cooperation with other information processing apparatuses including projection units to project images and imaging units to shoot a subject and obtain shot images; a correction information sharing unit that shares correction information as information relating to correction made to the images projected by the projection units of the information processing apparatuses belonging to the group formed by the group formation unit among the information processing apparatuses belonging to the group formed by the group formation unit; and a correction information updating unit that updates the correction information for the subject information processing apparatus on the basis of the shot image obtained by shooting the image projected by the projection unit as a subject and the correction information shared by the correction information sharing unit.
  • the correction information may include information relating to correction made to predetermined representative pixels in the image.
  • the information relating to correction made to the representative pixels may include coordinates before and after the correction of the representative pixels, the gain and shift values of respective color components of the representative pixels, and a coefficient of color conversion matrix of the representative pixels.
  • the information processing apparatus may further include a wireless communication unit that performs wireless communications, and the group formation unit may form the group including other information processing apparatuses with which wireless communications were performed by the wireless communication unit and the subject information processing apparatus.
  • the group formation unit may form the group including other information processing apparatuses connected to the subject information processing apparatus via predetermined communication cables and the subject information processing apparatus.
  • the group formation unit may generate group information as information relating to the formed group.
  • the group information may include identification information for identifying the group and the correction information for the information processing apparatuses constituting the group corresponding to the group information.
  • the group information may further include information relating to the kinds of contents data that were projected by the group in the past.
  • the group information may further include the layout of the images projected by the projection units of the information processing apparatuses belonging to the group at the time of projection of the contents data.
  • the group information may further include information relating to a projection plane onto which the images were projected.
  • the information processing apparatus may further include: a group information sharing unit that allows the group information to be shared among the information processing apparatuses belonging to the group; and a group information updating unit that updates the group information.
  • the information processing apparatus may further include a projection position control unit that controls the projection position of the image projected by the projection unit on the basis of the group information and the correction information.
  • the projection position control unit may project guiding images such that the images can be projected into the positions.
  • the information processing apparatus may further include an image cutout unit that cuts out a portion of the image included in the contents data to be projected by the projection unit on the basis of the group information.
  • the information processing apparatus may further include an image correction unit that corrects the portion of the image included in the contents data to be projected by the projection unit on the basis of the group information.
  • the information processing apparatus may further include a group separation unit that separates from the group formed by the group formation unit after notifying the separation from the group to the other information processing apparatuses belonging to the group.
  • the contents data may include image data and metadata.
  • the metadata may include information relating to the contents of the image data, genre, recommended projection image size, type, and resolution.
  • the contents data may have a plurality of image data.
  • one aspect of the present technology is an information processing method including: forming a group for projecting one contents data in cooperation with other information processing apparatuses including projection units to project images and imaging units to shoot a subject and obtain shot images; sharing correction information as information relating to correction made to the images projected by the projection units of the information processing apparatuses belonging to the formed group among the information processing apparatuses belonging to the formed group; and updating the correction information for the subject information processing apparatus on the basis of the shot image obtained by shooting the image projected by the projection unit as a subject and the shared correction information.
  • a group for projecting one contents data in cooperation with other information processing apparatuses including projection units to project images and imaging units to shoot a subject and obtain shot images is formed, correction information as information relating to correction made to the images projected by the projection units of the information processing apparatuses belonging to the formed group formed is shared among the information processing apparatuses belonging to the formed group, and the correction information for the subject information processing apparatus is updated on the basis of the shot image obtained by shooting the image projected by the projection unit as a subject and the shared correction information.
  • the present technology it is possible to process information.
  • FIG. 1 is a diagram illustrating a main configuration example of a projection imaging system.
  • FIG. 2A and FIG. 2B are a block diagram of an example of projection in cooperation.
  • FIG. 3 is a diagram illustrating an example of image correction.
  • FIG. 4 is a diagram illustrating an example of image correction.
  • FIGS. 5A, 5B, 5C and 5D are diagram describing a usage example.
  • FIG. 6 is a diagram illustrating an example of an outer appearance of the projection imaging apparatus.
  • FIG. 7 is a block diagram illustrating a main configuration example of the projection imaging apparatus.
  • FIG. 8 is a block diagram illustrating a main configuration example of a projection unit.
  • FIG. 9 is a diagram illustrating an example of scanning with laser light.
  • FIG. 10 is a functional block diagram illustrating an example of functions implemented by an SOC.
  • FIG. 11 is a block diagram illustrating a main configuration example of a contents provision server.
  • FIG. 12 is a flowchart describing an example of processes for group formation.
  • FIG. 13 is a diagram describing an example of group information.
  • FIGS. 14A, 14B and 14C are diagram describing an example of correction information.
  • FIG. 15A and FIG. 15B are a diagram describing an example of correction information.
  • FIG. 16 is a diagram describing an example of correction information.
  • FIGS. 17A, 17B, 17C, 17D and 17E are a diagram describing an example of projection position control.
  • FIGS. 18A, 18B, 18C and 18D are a diagram describing an example of projection position control.
  • FIGS. 19A, 19B and 19C is a diagram describing an example of projection position control.
  • FIG. 20 is a flowchart describing an example of processes for image projection.
  • FIGS. 21A and 21B are a diagram describing an example of image projection.
  • FIG. 22 is a diagram describing an example of metadata.
  • FIG. 23 is a flowchart describing an example of processes for group separation.
  • FIG. 24 is a block diagram illustrating a main configuration example of the projection imaging apparatus.
  • FIG. 25 is a diagram illustrating another configuration example of projection imaging system.
  • FIG. 26 is a diagram illustrating still another configuration example of projection imaging system.
  • FIGS. 27A and 27B are a diagram describing specifications on HDMI (registered trademark).
  • FIG. 28 is a diagram illustrating still another configuration example of projection imaging system.
  • FIG. 29 is a diagram illustrating still another configuration example of projection imaging system.
  • FIG. 30 is a diagram illustrating still another configuration example of projection imaging system.
  • Projection systems with a plurality of projectors are generally used to project images onto horizontally-long cylindrical projection planes at exhibition halls or perform projection mapping onto wall surfaces of buildings as a recent trend.
  • a personal computer outputs data to a plurality of projectors via a graphics processing unit (GPU) board or the like and causes the plurality of projectors to project images by an application software or a device driver on the PC in most cases.
  • GPU graphics processing unit
  • a correction image based on the correction data is generally created in the PC and output therefrom on the basis of imaging data in a specific pattern obtained by shooting with a camera connected via a universal serial bus (USB) to the PC.
  • USB universal serial bus
  • this system requires, besides the projectors, the PC for controlling, a camera for sensing, complicated programs for executing system operations, operators with technical knowledge, and others. It suits expensive and large-scaled systems but does not suit simple and less expensive systems that general users without expertise can enjoy casually. Therefore, it is not easy to allow the plurality of projectors to cooperate with one another in the system.
  • a group for projecting one contents data in cooperation with other information processing apparatuses each including a projection unit that projects images and an imaging unit that shoots a subject and obtains a shot image is formed, correction information as information relating to correction made to the image projected by the projection unit of the information processing apparatuses belonging to the formed group is shared among the information processing apparatuses belonging to the group formed by a group formation unit, and the correction information for the subject information processing apparatus is updated on the basis of the shot image obtained by shooting the image projected by the projection unit as a subject and the shared correction information.
  • the correction information may include information relating to correction made to predetermined representative pixels in the image.
  • the information relating to the correction made to the representative pixels may include coordinates before and after the correction of the representative pixel, the gain and shift values of respective color components of the representative pixels, and a coefficient of color conversion matrix of the representative pixels.
  • a wireless communication unit performing wireless communications may be further included.
  • the group formation unit may form the group including other information processing apparatuses with which wireless communications were performed by the wireless communication unit and the subject information processing apparatus.
  • the group formation unit may form the group including other information processing apparatuses connected to the subject information processing apparatus via predetermined communication cables and the subject information processing apparatus.
  • the group formation unit may generate group information as information relating to the formed group.
  • the group information may include identification information for identifying the group and the correction information for the information processing apparatuses constituting the group corresponding to the group information.
  • the group information may further include information relating to the kinds of contents data that were projected by the group in the past.
  • the group information may further include the layout of the images projected by the projection units of the information processing apparatuses belonging to the group at the time of projection of the contents data.
  • the group information may further include information relating to a projection plane onto which the images were projected.
  • a group information sharing unit that allows the group information to be shared among the information processing apparatuses belonging to the group and a group information updating unit that updates the group information may be further included.
  • a projection position control unit that controls the projection position of the image projected by the projection unit on the basis of the group information and the correction information may be further included.
  • the projection position control unit may further project guiding images such that the images can be projected into the positions.
  • An image cutout unit that cuts out a portion of the image included in the contents data to be projected by the projection unit on the basis of the group information may be further included.
  • An image correction unit that corrects the portion of the image included in the contents data to be projected by the projection unit on the basis of the group information may be further included.
  • a group separation unit that separates from the group formed by the group formation unit after notifying the separation from the group to the other information processing apparatuses belonging to the group may be further included.
  • contents data may include image data and metadata.
  • the metadata may include information relating to the contents of the image data, genre, recommended projection image size, type, and resolution.
  • the contents data may have a plurality of image data.
  • FIG. 1 illustrates a main configuration example of a projection imaging system to which a control apparatus is applied as an embodiment of the information processing apparatus to which the present technology is applied.
  • a projection imaging system 100 illustrated in FIG. 1 is a system that projects images.
  • the projection imaging system 100 can allow a plurality of projection imaging apparatuses to project contents of moving images, still images, and others in cooperation as described above.
  • the projection imaging system 100 has projection imaging apparatuses 101 - 1 to 101 - 4 .
  • the projection imaging apparatuses 101 - 1 to 101 - 4 are apparatuses that project images onto a screen 102 and shoot images projected on the screen 102 .
  • the projection imaging apparatuses 101 - 1 to 101 - 4 have similar configurations and have similar functions. In the following description, the projection imaging apparatuses 101 - 1 to 101 - 4 will be called projection imaging apparatuses 101 when there is no need to discriminate among them.
  • the projection imaging apparatuses 101 are in the state of being communicable with one another by wireless communication such as a wireless local area network (LAN) via an access point 103 , for example.
  • the projection imaging apparatuses 101 are connected to a network 104 via the access point 103 and can communicate with other apparatuses connected to the network 104 .
  • LAN wireless local area network
  • the access point 103 is a device relaying communications, and can communicate wirelessly with the projection imaging apparatuses 101 and is connected to the network 104 .
  • the access point 103 can relay the communications among the projection imaging apparatuses 101 .
  • the access point 103 can also relay the communications between the projection imaging apparatuses 101 and the network 104 (other communication apparatuses connected to the network 104 ).
  • the network 104 is a communication network as a communication medium.
  • the network 104 may be any communication network, and may be a wired communication network, a wireless communication network, or both.
  • the network 104 may be a wired LAN, a wireless LAN, a public telephone network, a wide area communication network for wireless mobile objects such as a 3G line or a 4G line, the Internet, or a combination of these.
  • the network 104 may be a single communication network or a plurality of communication networks.
  • the network 104 may be partly or entirely composed of a communication cable under predetermined standards such as a universal serial bus (USB) cable or a high-definition multimedia interface (HDMI) cable, for example.
  • USB universal serial bus
  • HDMI high-definition multimedia interface
  • a contents provision server 105 a contents provision server 105 , a group information management server 106 , and the like are connected to the network 104 .
  • the contents provision server 105 is a server that provides the projection imaging apparatuses 101 with contents data including the images to be projected by the projection imaging apparatuses 101 .
  • the contents provision server 105 manages the contents data to be provided and provides the contents data in response to a request from the client side such as the projection imaging apparatuses 101 , for example.
  • Means for providing the contents data can be arbitrarily set but the contents data is to be provided via the network 104 and the access point 103 , for example.
  • the method for providing the contents data can be arbitrarily set and may be streaming delivery or downloading. Further, the providing service may be fee-charging service or free service.
  • the contents data include one or more image data, audio data, metadata including control information, and the like. These data may be archived and further compressed, and may be independent of one another.
  • the group information management server 106 manages group information as information relating to the group formed by the plurality of projection imaging apparatuses 101 .
  • the group information management server 106 stores and manages the group information provided by the projection imaging apparatuses 101 as clients, that is, information on the groups formed in the past (a history of group information).
  • the group information management server 106 provides the requested group information out of the managed group information to the client as a requester. That is, the projection imaging apparatuses 101 can easily reproduce a group similar to the group formed in the past by making group settings on the basis of the group information. In addition, the projection imaging apparatuses 101 can form a new group more easily by modifying the group information.
  • the means for providing the group information can be arbitrarily set, the group information is provided via the network 104 and the access point 103 , for example.
  • This service may be a fee-charging service or a free service.
  • the contents provision server 105 and the group information management server 106 can be arbitrarily configured.
  • the contents provision server 105 and the group information management server 106 may be implemented by one server 107 , or the contents provision server 105 or the group information management server 106 or both may be implemented by a plurality of servers.
  • these servers may be provided as a cloud service.
  • the screen 102 is an example of a plane onto which the projection imaging apparatuses 101 project images (projection plane).
  • the screen 102 may be a flat plane or a curved plane.
  • the surface of the screen 102 may have asperities.
  • the color of the screen 102 can be arbitrarily set.
  • a predetermined three-dimensional structure for example, a building, a wall, a floor, furniture, a small object, a living object, or the like
  • a projection plane for example, a building, a wall, a floor, furniture, a small object, a living object, or the like
  • the source of provision of images to be projected by the projection imaging apparatuses 101 can be arbitrarily set.
  • the images may be stored in advance in the projection imaging apparatuses 101 or may be provided to the projection imaging apparatuses 101 by the use of a recording medium or the like.
  • the contents provision server 105 and the group information management server 106 are unnecessary.
  • the network 104 is also unnecessary.
  • the projection imaging apparatuses 101 may communicate with one another without the access point 103 .
  • the communication method can be arbitrarily set, and may be wireless communication or wired communication. In that case, the access point 103 is also unnecessary.
  • the contents provision server 105 provides contents data including a progressive scanned image (4K@60P) at a resolution 4K (for example, 4096 ⁇ 2160) and a frame rate of 60 fps to the individual projection imaging apparatuses 101 .
  • each of the projection imaging apparatuses 101 cuts a partial image (for example, a progressive scanned image (1080@60P) at a resolution of full HD and a frame rate of 60 fps) assigned thereto from the image (4K@60P) and projects the cut image onto the screen 102 .
  • the projection imaging apparatuses 101 project images in such a layout as illustrated in FIG. 2A .
  • the projection imaging apparatuses 101 project two vertically arranged images and two horizontally arranged images (2 ⁇ 2) onto the screen 102 . More specifically, the projection imaging apparatus 101 - 1 projects a projection image 111 - 1 onto the upper left of the screen 102 , the projection imaging apparatus 101 - 2 projects a projection image 111 - 2 onto the lower left of the screen 102 , the projection imaging apparatus 101 - 3 projects a projection image 111 - 3 onto the upper right of the screen 102 , and the projection imaging apparatus 101 - 4 projects a projection image 111 - 4 onto the lower right of the screen 102 .
  • the projection images 111 - 1 to 111 - 4 will be called projection images 111 when there is no need to discriminate among them.
  • the projection images 111 - 1 to 111 - 4 partially overlap one another to form one region.
  • the individual projection images 111 include the partial images (1080@60P) described above.
  • a projection image 112 of the image (4K@60P) is formed on the screen 102 .
  • the projection image 111 - 1 includes the upper left partial image of the image (4K@60P)
  • the projection image 111 - 2 includes the lower left partial image of the image (4K@60P)
  • the projection image 111 - 3 includes the upper right partial image of the image (4K@60P)
  • the projection image 111 - 4 includes the lower right partial image of the image (4K@60P).
  • the projection images 111 overlap partially one another, and therefore the partial images included in the projection images 111 may be images higher in resolution (that is, wider) than the full-HD image.
  • the projection imaging system 100 can project the image (4K@60P) at a resolution of 4K without lowering the resolution (without decreasing image quality).
  • the projection images 111 need to be subjected to positioning, geometric correction, and the like.
  • the projection imaging apparatuses 101 include the imaging function and can use the imaging function to sense the projection images projected by itself and the other apparatuses as illustrated in FIG. 2B .
  • the projection imaging apparatuses 101 make various corrections on the basis of the sensor data, whereby the partial images can be combined in a more natural manner on the screen 102 to form the one projection image 112 .
  • the contents of the image corrections include projector individual variability correction, overlap correction, screen shape correction, and others as illustrated in FIG. 2B .
  • the projector individual variability correction is correction for luminance, gamma, brightness, contrast, white balance, color tone, and the like, for example.
  • the overlap correction is correction made to an overlap region in which the projection images 111 overlap one another.
  • the overlap correction may include level correction, distortion correction, and the like.
  • the screen shape correction is correction for the shape and posture of the screen 102 .
  • the screen shape correction may include projection transform (flat plane, sphere, cylinder (circular column shape), and polynomial curve). As a matter of course, any correction other than these may be made.
  • the projection image becomes distorted without correction.
  • the distortion can be reduced by projection transform and the like.
  • those images can be projected as one image by projection transform and the like.
  • the projection imaging system 100 enables various projection modes. For example, by aligning a plurality of projection images as illustrated in FIG. 5A , the resolution of the entire projection image can be increased.
  • the aspect ratio of the projection image (entire image) can be freely set independently of the specifications of the projection imaging apparatuses 101 depending on the alignment of the projection images (partial images) projected by the projection imaging apparatuses 101 .
  • images can be projected without distortion onto a plurality of walls and ceilings (that is, screens oriented in a plurality of directions (in other words, a three-dimensional structure)).
  • images can be projected without distortion onto a wide and curved screen surrounding viewers.
  • the projection image With improvement in the degree of freedom for the projection plane, the projection image increases in expressiveness to enhance realistic feeling and visibility, for example, thereby improving entertainment value and artistic quality.
  • FIG. 6 illustrates an example of outer appearance of the projection imaging apparatus 101 .
  • the projection imaging apparatus 101 has the projection function and the imaging function as described above.
  • the casing of the projection imaging apparatus 101 is provided with optical devices such as a projection opening (lens mechanism) for projecting images and a camera for imaging a subject (lens mechanism).
  • the projection imaging apparatus 101 may be an apparatus of any size and may be a portable (small-sized) apparatus, for example.
  • the casing of the projection imaging apparatus 101 may be provided with a battery. By providing the battery, the projection imaging apparatus 101 can be driven without an external power source, thereby improving the degree of freedom for the placement position. That is, the plurality of projection imaging apparatuses 101 can project images more easily in cooperation.
  • FIG. 7 is a block diagram illustrating a main configuration example of the projection imaging apparatus 101 .
  • the projection imaging apparatus 101 has a system-on-a-chip (SOC) 151 , a random access memory (RAM) 152 , an input unit 161 , a display unit 162 A, an audio output unit 162 B, a storage unit 163 , a communication unit 164 , a drive 165 , a projection unit 181 , an imaging unit 182 , a near field communication (NFC) unit 191 , a sensor unit 192 , and a touch panel 193 .
  • SOC system-on-a-chip
  • RAM random access memory
  • the SOC 151 is a chip with various functions implemented by the projection imaging apparatus 101 .
  • the SOC 151 loads programs and data into the RAM 152 and executes the same.
  • the input unit 161 is composed of external input terminals such as an HDMI terminal and input devices such as operation buttons and a microphone, for example.
  • the display unit 162 A has a display device displaying images and messages, for example.
  • the audio output unit 162 B is composed of a speaker and the like, for example.
  • the storage unit 163 is composed of a hard disc, a RAM disc, a non-volatile memory, and the like, for example.
  • the communication unit 164 is composed of a network interface, for example.
  • the drive 165 drives a removable medium 171 such as a magnetic disc, an optical disc, a magneto-optical disc, or a semiconductor memory to read information from the removable medium 171 and write information into the removable medium 171 , for example.
  • the projection unit 181 performs processes relating to image projection.
  • the projection unit 181 projects an image supplied by the SOC 151 onto the outside of the projection imaging apparatus 101 (for example, the screen 102 or the like). That is, the projection unit 181 implements the projection function.
  • the projection unit 181 uses laser light as a light source to perform scanning with the laser light using an MEMS mirror to project the image.
  • the light source of the projection unit 181 can be arbitrarily set, and is not be limited to the laser light but may be a light emitting diode (LED), a xenon lamp, or the like. The details of the projection unit 181 will be provided later.
  • the imaging unit 182 shoots a subject outside the apparatus, generates a shot image of the subject, and supplies the shot image to the SOC 151 . That is, the imaging unit 182 implements the imaging function. For example, the imaging unit 182 shoots a projection image projected by the projection unit 181 onto the screen 102 .
  • the NFC unit 191 performs proximity wireless communications with another communication device in proximity. For example, the NFC unit 191 transmits and receives information relating to communication settings necessary for establishing communications by the communication unit 164 through the near field wireless communications.
  • the sensor unit 192 has arbitrary sensors such as an acceleration sensor, an optical sensor, and a temperature sensor, and supplies the SOC 151 with information relating to environments outside the projection imaging apparatus 101 obtained by sensing (sensor data).
  • the touch panel 193 is superimposed on the screen image display surface of the display unit 162 A, for example.
  • the touch panel 193 accepts information indicated by an operation performed on the basis of a GUI displayed on the display unit 162 A (that is, user input), and supplies the accepted user input to the SOC 151 .
  • the SOC 151 loads programs stored in the storage unit 163 into the RAM 152 and executes the same to perform various processes, for example.
  • the RAM 152 also stores as appropriate data necessary for the SOC 151 to execute the various processes.
  • the programs executed by the SOC 151 can be recorded in the removable medium 171 as a package medium or the like, for example, and provided to the projection imaging apparatus 101 . In that case, the programs can be installed into the storage unit 163 via the SOC 151 by attaching the removable medium 171 to the drive 165 .
  • the programs can also be provided to the projection imaging apparatus 101 via a wired or wireless transfer medium such as a LAN, the Internet, or digital satellite broadcasting.
  • the programs can be received by the communication unit 164 via the wired or wireless transfer medium and installed in the storage unit 163 .
  • the programs can also be installed in advance in the ROM in the SOC 151 or the storage unit 163 .
  • FIG. 8 is a block diagram illustrating a main configuration example of the projection unit 181 .
  • the projection unit 181 has a video processor 201 , a laser driver 202 , a laser output unit 203 - 1 , a laser output unit 203 - 2 , a laser output unit 203 - 3 , a mirror 204 - 1 , a mirror 204 - 2 , a mirror 204 - 3 , a micro electro mechanical systems (MEMS) driver 205 , and a MEMS mirror 206 .
  • MEMS micro electro mechanical systems
  • the video processor 201 holds the images supplied by the SOC 151 and performs necessary image processing on the images.
  • the video processor 201 supplies the image to be projected to the laser driver 202 and the MEMS driver 205 .
  • the laser driver 202 controls the laser output units 203 - 1 to 203 - 3 to project the image supplied by the video processor 201 .
  • the laser output units 203 - 1 to 203 - 3 output laser light of different colors (wavelength regions) of red, blue, green, and the like, for example. That is, the laser driver 202 controls laser output of respective colors to project the image supplied by the video processor 201 .
  • the laser output units 203 - 1 to 203 - 3 will be called laser output units 203 when there is no need to discriminate among them.
  • the mirror 204 - 1 reflects the laser light output from the laser output unit 203 - 1 and guides the same to the MEMS mirror 206 .
  • the mirror 204 - 2 reflects the laser light output from the laser output unit 203 - 2 and guides the same to the MEMS mirror 206 .
  • the mirror 204 - 3 reflects the laser light output from the laser output unit 203 - 3 and guides the same to the MEMS mirror 206 .
  • the mirrors 204 - 1 to 204 - 3 will be called mirrors 204 when there is no need to discriminate among them.
  • the MEMS driver 205 controls driving of the MEMS mirror 206 to project the image supplied by the video processor 201 .
  • the MEMS mirror 206 drives the mirror attached to the MEMS in accordance with the control of the MEMS driver 205 to perform scanning with the laser light of respective colors as in the example of FIG. 9 , for instance.
  • the laser light is output from the projection opening to the outside of the apparatus and then applied to the screen 102 , for example. Accordingly, the image supplied from the video processor 201 is projected onto the screen 102 .
  • three laser output units 203 are provided to output laser light of three colors.
  • the number of laser lights (or the number of colors) can be arbitrarily set.
  • the number of the laser output units 203 may be four or more or two or less, for example. That is, the number of beams of laser light output from the projection imaging apparatus 101 (the projection unit 181 ) may be two or less or four or more.
  • the number of colors of laser light output from the projection imaging apparatus 101 (the projection unit 181 ) can be also arbitrarily set and may be two or less or four or more.
  • the configuration of the mirrors 204 and the MEMS mirror 206 can be arbitrarily set and is not limited to the example of FIG. 8 . As a matter of course, the scanning pattern with the laser light can be arbitrarily set.
  • the SOC 151 of the projection imaging apparatus 101 executes the programs to implement various functions.
  • FIG. 10 is a functional block diagram illustrating an example of functions implemented by the SOC 151 .
  • the SOC 151 implements functional blocks such as a group formation unit 221 , a projection position control unit 222 , a correction information sharing unit 223 , a correction information updating unit 224 , a group information updating unit 225 , a group information sharing unit 226 , an image cutout unit 227 , an image correction unit 228 , an image projection control unit 229 , a group separation unit 230 , and the like.
  • the group formation unit 221 performs a process for grouping the projection imaging apparatuses 101 .
  • the projection position control unit 222 performs a process for controlling the projection position of the projection image.
  • the correction information sharing unit 223 performs a process for sharing correction information.
  • the correction information updating unit 224 performs a process for updating the correction information.
  • the group information updating unit 225 performs a process for updating group information.
  • the group information sharing unit 226 performs a process for sharing the group information.
  • the image cutout unit 227 performs a process for cutting out the images to be projected.
  • the image correction unit 228 performs a process for correcting the image to be projected.
  • the image projection control unit 229 performs a process for controlling the projection of the image.
  • the group separation unit 230 performs a process for separating from the group.
  • these functional blocks perform the processes to form storage regions in the storage unit 163 such as a group information storage unit 241 , a correction information storage unit 242 , and a sensor data storage unit 243 , for example.
  • the group information storage unit 241 is a storage region for storing the group information.
  • the correction information storage unit 242 is a storage region for storing the correction information.
  • the sensor data storage unit 243 is a storage region for storing the sensor data.
  • FIG. 11 is a block diagram illustrating a main configuration example of the contents provision server 105 .
  • a central processing unit (CPU) 301 a read only memory (ROM) 302 , and a random access memory (RAM) 303 are connected together via a bus 304 .
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • An input/output interface 310 is also connected to the bus 304 .
  • An input unit 311 , an output unit 312 , a storage unit 313 , a communication unit 314 , and a drive 315 are connected to the input/output interface 310 .
  • the input unit 311 is composed of an input device that accepts external information such as user input.
  • the input unit 311 includes operation buttons, a touch panel, a camera, a microphone, input terminals, and others.
  • the input unit 311 may include various sensors such as an acceleration sensor, an optical sensor, and a temperature sensor.
  • the output unit 312 is composed of an output device that outputs information such as images and audio.
  • the output unit 312 includes a display, a speaker, output terminals, and others.
  • the storage unit 313 is composed of a hard disc, a RAM disc, a non-volatile memory, and the like, for example.
  • the communication unit 314 is composed of a network interface, for example.
  • the communication unit 314 is connected to the network 104 to communicate with another apparatus (for example, the projection imaging apparatus 101 ) connected via the network 104 , for example.
  • the drive 315 drives a removable medium 321 such as a magnetic disc, an optical disc, a magneto-optical disc, or a semiconductor memory, for example.
  • the CPU 301 loads programs stored in the storage unit 313 into the RAM 303 via the input/output interface 310 and the bus 304 and executes the same to perform various processes, for example.
  • the RAM 303 also stores as appropriate data necessary for the CPU 301 to execute the various processes.
  • the programs executed by the CPU 301 can be recorded in the removable medium 321 as a package medium or the like, for example, and provided to the contents provision server 105 .
  • the programs can be installed into the storage unit 313 via the input/output interface 310 by attaching the removable medium 321 to the drive 315 .
  • the programs can also be provided to the contents provision server 105 via a wired or wireless transfer medium such as a LAN, the Internet, or digital satellite broadcasting.
  • a wired or wireless transfer medium such as a LAN, the Internet, or digital satellite broadcasting.
  • the programs can be received by the communication unit 314 via the wired or wireless transfer medium and installed in the storage unit 313 .
  • the programs can also be installed in advance in the ROM 302 or the storage unit 313 .
  • the group information management server 106 is configured in a manner similar to the contents provision server 105 . That is, the description in FIG. 11 is also applicable to the group information management server 106 .
  • the server 107 is also configured in a manner similar to the contents provision server 105 . That is, the description in FIG. 11 is also applicable to the server 107 .
  • FIG. 12 illustrates an example of flows of processes by which the projection imaging apparatuses 101 - 2 to 101 - 4 form a group and the projection imaging apparatus 101 - 1 joins the group.
  • the method for forming a group can be arbitrarily set. For example, causing the projection imaging apparatuses 101 to perform proximity wireless communications may serve as a trigger for group formation. That case will be explained below.
  • the projection imaging apparatus 101 - 1 is an apparatus newly joining the group
  • the projection imaging apparatus 101 - 2 is an apparatus that accepts the joining of the projection imaging apparatus 101 - 1 (performs proximity wireless communications with the projection imaging apparatus 101 - 1 )
  • the projection imaging apparatuses 101 - 3 and 101 - 4 are apparatuses that have joined the group before.
  • the process performed by the projection imaging apparatus 101 - 4 is similar to that of the projection imaging apparatus 101 - 3 and descriptions thereof are omitted.
  • the group formation units 221 of the projection imaging apparatuses 101 - 1 and 101 - 2 use the NFC units 191 to start proximity wireless communications and exchange information necessary for establishment of communications with the use of the communication units 164 (steps S 101 and S 111 ).
  • the group formation units 221 of the projection imaging apparatuses 101 - 1 and 101 - 2 use the exchanged communication information to establish wireless communications with the use of the communication units 164 . Further, the group formation unit 221 of the projection imaging apparatus 101 - 1 also establishes communications with the projection imaging apparatuses 101 - 3 and 101 - 4 in similar manners.
  • the group formation unit 221 of the projection imaging apparatus 101 - 1 Upon the establishment of the wireless communications, the group formation unit 221 of the projection imaging apparatus 101 - 1 provides information relating to the subject apparatus to the other projection imaging apparatuses 101 by the wireless communications with the use of the communication units 164 to make a request for joining the group, for example.
  • the group formation units 221 of the projection imaging apparatuses 101 - 2 to 101 - 4 use the information from the projection imaging apparatus 101 - 1 to update the existing group information, and share the updated group information among the projection imaging apparatuses 101 - 1 to 101 - 4 by wireless communications with the use of the communication units 164 , for example (steps S 102 , S 112 , and S 121 ).
  • steps S 102 , S 112 , and S 121 When no group is formed, there exists no group information. Accordingly, the projection imaging apparatuses 101 generate newly group information and share the same.
  • the CPU 301 of the group information management server 106 provides past group information (historical group information) on the groups formed by the projection imaging apparatuses 101 - 1 to 101 - 4 requested by the projection imaging apparatuses 101 or the like via the communication unit 314 to the projection imaging apparatuses 101 - 1 to 101 - 4 (step S 131 ).
  • the projection imaging apparatuses 101 receive the historical group information by wireless communications via the communication units 164 , for example (steps S 103 , S 113 , and S 122 ), and use the received information when it is usable, and discard the received information when it is not usable.
  • FIG. 13 illustrates an example of group information.
  • the group information includes group identification information (group ID), information indicative of the apparatuses belonging to the group and correction information held by the apparatuses (apparatus and correction information), information indicative of the type of the contents projected by the group (content type), information indicative of the layout of the projection screen for the projection of the contents (projection screen layout), information on the projection plane (screen or the like) onto which the contents are projected (projection plane), and the like.
  • group ID group identification information
  • apparatus and correction information information indicative of the type of the contents projected by the group
  • content type information indicative of the layout of the projection screen for the projection of the contents
  • projection screen layout information on the projection plane (screen or the like) onto which the contents are projected
  • projection plane screen or the like
  • the projection position control units 222 of the projection imaging apparatuses 101 control the positions of the images projected by the projection units 181 on the basis of the group information, the correction information (information such as various variables used for image correction), and the like (steps S 104 , S 114 , and S 123 ).
  • the correction information may be information on individual pixels (indicating how to correct the individual pixels).
  • the correction information may be information on all the pixels of the image to be projected as illustrated in FIG. 14A , or may be information on representative points in the image as illustrated in FIG. 14B . This makes it possible to reduce the amount of the correction information and, for example, reduce the storage capacity necessary for storage in the storage unit 163 .
  • the correction information on the pixels other than the representative points is interpolated on the basis of the correction information on the representative points at the time of image correction (at the time of using the correction information) as illustrated in FIG. 14C .
  • the contents of the correction information can be arbitrarily set but may be geometric information as in the example of FIG. 15A and FIG. 15B , for instance.
  • the correction information includes geometric information on the individual representative points in the input image ( FIG. 15A ) indicating how the representative points will move after the correction ( FIG. 15B ).
  • FIG. 16 illustrates a specific example of correction information.
  • the correction information includes various parameters as illustrated in FIG. 16 , for example.
  • the correction information includes coordinates before and after correction of a target point, gain and shift values of individual colors before and after the correction, and a coefficient of color conversion matrix.
  • the correction information sharing units 223 of the projection imaging apparatuses 101 share one another's correction information by wireless communications via the communication units 164 , for example (steps S 105 , S 115 , and S 124 ).
  • the correction information updating units 224 of the projection imaging apparatuses 101 update the correction information such that the projection imaging apparatuses 101 can project properly projection images in cooperation on the basis of the group information, the projection positions, the correction information, and the like (steps S 106 , S 116 , and S 125 ).
  • the correction information is updated such that one projection image can be formed from a plurality of projection images.
  • the correction information sharing units 223 of the projection imaging apparatuses 101 share one another's correction information after the correction by wireless communications via the communication units 164 , for example (steps S 107 , S 117 , and S 126 ).
  • the projection position control units 222 of the projection imaging apparatuses 101 control the positions of the images projected by the projection units 181 on the basis of the group information, the updated correction information, and the like (steps S 108 , S 118 , and S 127 ). Accordingly, the projection positions are in the appropriate state (for example, as in the example of FIG. 2A , one projection image is formed from a plurality of projection images).
  • FIGS. 17A, 17B, 17C, 17D and 17E illustrates an example.
  • one entire image 401 formed from four projection images 111 may be projected as illustrated in FIG. 17A
  • part of the image 401 formed from the three projection images 111 may be projected as illustrated in FIG. 17B
  • the entire image 401 formed from the three projection images 111 may be projected as illustrated in FIG. 17C
  • portions of the image 401 formed from the projection images 111 may be projected (without overlapping) as illustrated in FIG. 17D
  • images 402 and 403 formed from two other projection images 111 may be projected as illustrated FIG. 17E . That is, the projected contents data may include a plurality of images.
  • the projection position control unit 222 may provide indications for guiding in moving the projection images (guiding indications) together with the projection images or the like.
  • the image 401 is projected onto a region formed by a projection image 111 - 1 and a projection image 111 - 3 as illustrated in FIG. 18A .
  • Adding a projection image 111 - 2 and a projection image 111 - 4 to this region can display the image 401 in a larger size as illustrated in FIG. 18D .
  • the projection position control unit 222 may display a message saying “lay on this region” or the like, for example, in the region formed by the projection images 111 - 1 and 111 - 3 as illustrated in FIG. 18B . Accordingly, the user can recognize more easily how to move the projection images 111 - 2 and 111 - 4 .
  • the projection position control unit 222 may display a message saying “correctable overlap” or the like in the region formed by the projection images 111 - 1 to 111 - 4 as illustrated in FIG. 18C , for example. Accordingly, the user can recognize more easily that the projection images 111 are in the appropriate positions.
  • the projection images 111 may not be laid out such that the projection images overlap and form one region as in the example of FIG. 17A .
  • the projection imaging apparatuses 101 may project the images so as not to overlap, thereby displaying a plurality of images in cooperation as illustrated in FIG. 17E .
  • the projection positions may be controlled not only such that a plurality of projection images is moved to overlap as in the example of FIGS. 18A, 18B, 18C and 18D but also such that the projection images overlapping and forming one region as illustrated in FIG. 19A are moved so as not to overlap as illustrated in FIG. 19B . Accordingly, the images 401 to 403 can be displayed simultaneously as illustrated in FIG. 19C .
  • the group information updating units 225 of the projection imaging apparatuses 101 update the group information by the use of the updated correction information and the like. Then, the group information sharing units 226 of the projection imaging apparatuses 101 share the updated group information among the projection imaging apparatuses 101 - 1 to 101 - 4 by wireless communications via the communication units 164 , for example (steps S 109 , S 119 , and S 128 ).
  • the manner of projecting the images for example, the layout of the images, the projection sizes of the images, and the like may be determined by the user or the like deciding the positions of the projection images or may be determined by the contents (metadata of the contents), for example.
  • the contents may be composed of a down shot of a field (image 401 ), a close-up of players (image 402 ), data on players (image 403 ), and the like.
  • the metadata of the contents contains information on the individual images (content name, genre, recommended size, type, size, and the like) as illustrated in FIG. 22 .
  • one large region may be formed from two projection images 111 to project the down shot of the field (image 401 ) in a large size, and the close-up of players (image 402 ) and the data on players (image 403 ) not to be projected in so large sizes may be formed from one each projection image 111 .
  • the down shot of the field (image 401 ) may be projected in a large size onto the largest region formed from the projection images 111 - 1 and 111 - 3 , and the close-up of players (image 402 ) and the data on players (image 403 ) may be projected onto the two remaining regions.
  • FIG. 21B illustrates the case in which the contents are a car race game. This case is similar to the case of a soccer game.
  • the image seen from the outside of a racing car and the images seen from the driver's eyes in the individual racing cars may be controlled to be projected onto regions of appropriate sizes and in appropriate positions on the basis of the metadata of the contents or the positions of the projection images.
  • FIG. 12 illustrates the example of flows of processes in which the projection imaging apparatuses 101 - 1 to 101 - 4 form a group and the projection imaging apparatuses 101 project images in cooperation.
  • the contents provision server 105 supplies requested contents data to the projection imaging apparatuses 101 via the communication unit 314 (step S 181 ).
  • the projection imaging apparatuses 101 receive the contents data by wireless communications via the communication units 164 , for example (steps S 151 , S 161 , and S 171 ).
  • the image cutout units 227 of the projection imaging apparatuses 101 cut out partial images in regions assigned thereto from the image included in the contents data as necessary on the basis of the group information, the metadata included in the contents data, and the like (steps S 152 , S 162 , and S 172 ). These steps are omitted when the projection imaging apparatuses 101 project the entire image.
  • the image correction units 228 of the projection imaging apparatuses 101 correct the cutout images on the basis of the metadata, the group information, the correction information, and the like (steps S 153 , S 163 , and S 173 ).
  • the image projection control units 229 of the projection imaging apparatuses 101 control the projection units 181 to project the corrected images onto the screen 102 or the like (steps S 154 , S 164 , and S 174 ).
  • each of the projection imaging apparatuses 101 can project more easily the images in cooperation with the other projection imaging apparatuses 101 by the use of the group information, the correction information, the metadata, and the like.
  • FIG. 23 illustrates the example of flows of processes in which the projection imaging apparatuses 101 - 1 to 101 - 4 form a group and the projection imaging apparatus 101 - 1 is separating from the group.
  • the group separation unit 230 of the projection imaging apparatus 101 - 1 separating from the group uploads the current group information to the group information management server 106 by wireless communications via the communication unit 164 , for example (step S 201 ).
  • the group information management server 106 stores and manages the group information as a history (step S 231 ).
  • the group separation unit 230 of the projection imaging apparatus 101 - 1 notifies the separation from the group to another projection imaging apparatus 101 in the same group (at least one of the projection imaging apparatuses 101 - 2 to 101 - 4 ) by wireless communications via the communication unit 164 , for example (step S 202 ).
  • the group information updating unit 225 of at least one of the projection imaging apparatuses 101 - 2 to 101 - 4 updates the group information to exclude the projection imaging apparatus 101 - 1 .
  • the group information sharing units 226 of the projection imaging apparatuses 101 - 2 to 101 - 4 share the updated group information (steps S 211 and S 221 ).
  • the group separation unit 230 of the projection imaging apparatus 101 - 1 having separated from the group deletes the group information on the group from the group information storage unit 241 (step S 203 ).
  • the projection position control units 222 of the projection imaging apparatuses 101 - 2 to 101 - 4 remaining in the group control the projection such that these projection imaging apparatuses cooperate with one another as the group excluding the projection imaging apparatus 101 - 1 (steps S 212 and S 222 ).
  • the correction information sharing units 223 of the projection imaging apparatuses 101 - 2 to 101 - 4 share one another's correction information by wireless communications via the communication units 164 , for example (steps S 213 and S 223 ).
  • the correction information updating units 224 of the projection imaging apparatuses 101 - 2 to 101 - 4 update the correction information such that the projection imaging apparatuses 101 - 2 to 101 - 4 can project properly the projection images in cooperation on the basis of the group information, the projection positions, the correction information, and the like (steps S 214 and S 224 ).
  • the correction information sharing units 223 of the projection imaging apparatuses 101 - 2 to 101 - 4 share one another's corrected correction information by wireless communications via the communication units 164 , for example (steps S 215 and S 225 ).
  • the projection position control units 222 of the projection imaging apparatuses 101 - 2 to 101 - 4 control the positions of the images projected by the projection units 181 on the basis of the group information, the updated correction information, and the like (steps S 216 and S 226 ). Accordingly, the projection positions are brought into the proper states.
  • the group information updating units 225 of the projection imaging apparatuses 101 - 2 to 101 - 4 update the group information by the use of the updated correction information and the like.
  • the group information sharing units 226 of the projection imaging apparatuses 101 - 2 to 101 - 4 share the updated group information among the projection imaging apparatuses 101 - 2 to 101 - 4 by wireless communications via the communication units 164 , for example (steps S 217 and S 227 ).
  • the projection imaging apparatus 101 can easily separate from the group. This makes easier to allow the projection imaging apparatuses to form a group and the plurality of projection units to project the images in cooperation.
  • FIG. 7 is a block diagram illustrating a main configuration example of the projection imaging apparatus 101 .
  • the configuration example of the projection imaging apparatus 101 is not limited to this.
  • the projection imaging apparatus 101 may be configured as in the example of FIG. 24 .
  • the projection imaging apparatuses 101 perform processes on the image to be projected (for example, image cutout, image correction, and the like) by a video processor 503 .
  • the image (a video stream or the like) input via an input unit 161 (an HDMI cable or the like) is supplied to the video processor 503 via an input switch unit 501 .
  • the image (an image file or the like) acquired via the communication unit 164 is supplied to the video processor 503 from an SOC 151 via the input switch unit 501 .
  • the SOC 151 controls the video processor 503 and the projection unit 181 via a control unit 502 to perform image processing, image output (projection), audio output, and the like.
  • the processes to be executed are similar to those in the case of the configuration of FIG. 7 .
  • the video processor 503 performs the image processing and the like to reduce a burden on the SOC 151 .
  • FIG. 1 illustrates a configuration example of the projection imaging system 100 but the configuration example of the projection imaging system 100 is not limited to this.
  • any one of the projection imaging apparatuses 101 may be set as master and the other projection imaging apparatuses 101 as slaves such that the projection imaging apparatus 101 as master executes the various processes described above such as group management, correction information management, and image processing, and the projection imaging apparatuses 101 as slaves merely receive and project the corrected images.
  • the projection imaging apparatus 101 as master needs to have sufficient processing ability, which reduces the required processing ability of the other projection imaging apparatuses 101 (as slaves). Therefore, it is possible to achieve cost reduction.
  • the projection imaging system 100 may be composed of the projection imaging apparatuses 101 different in processing ability.
  • the projection imaging apparatuses 101 may communicate with one another in a wired manner.
  • the projection imaging apparatuses 101 may be connected together via communication cables 521 (communication cables 521 - 1 to 521 - 4 ) such as HDMI cables.
  • communication cables 521 communication cables 521 - 1 to 521 - 4
  • HDMI cables such as HDMI cables.
  • the HDMI cables include a consumer electronic control (CEC) line as illustrated in FIG. 27A .
  • the CEC line of the HDMI cables is generally used for communications of command groups and the like operated by a remote control such as instructions for power on/off between connected devices and instructions for replay/stop of running systems.
  • Using the table as illustrated in FIG. 27B also allows other data communications. That is, it is possible to transmit collection data and the like by the use of the CEC.
  • the projection imaging apparatuses 101 may be connected in a daisy chain mode as in the example of FIG. 26 .
  • the projection imaging apparatuses 101 may be connected by the use of a conversion box 531 as illustrated in FIG. 28 .
  • image processing such as image cutout and correction may be performed in the conversion box 531 .
  • sensing data obtained by the projection imaging apparatuses 101 may be collected by the conversion box 531 (dot-line arrows 532 - 1 to 532 - 4 ).
  • the sensing data may be collected by the use of the communication cables 521 as described above, or may be collected by new communication cables other than the communication cables 521 , or may be collected by wireless communications.
  • the number of the projection imaging apparatuses 101 connected to the conversion box 531 can be arbitrarily set in theory. In actuality, however, the existing conversion boxes are all capable of connecting only several projection imaging apparatuses 101 . Nevertheless, a plurality of conversion boxes 531 may be connected to group a larger number of projection imaging apparatuses 101 as illustrated in FIG. 29 .
  • the conversion boxes 531 may be connected via the communication cables 521 , any other communication cables, wireless communications, or the like.
  • an HDMI splitter 541 may be used as illustrated in FIG. 30 .
  • the HDMI splitter 541 simply branches the input contents data and supplies the same to the plurality of projection imaging apparatuses 101 . Therefore, in this case, various processes such as image processing, and management and control of the group information and the correction information are performed in the projection imaging apparatuses 101 as in the case of FIG. 1 .
  • the collection data may be shared among the projection imaging apparatuses 101 via communication cables 542 , wireless communications, or the like.
  • the series of processes described above may be executed by hardware or software.
  • programs constituting the software are installed from a network or a recording medium.
  • the recording medium is composed of the removable medium 171 or the removable medium 321 recording the programs to be distributed to the users for delivery of the programs separately from the apparatus itself as illustrated in FIG. 7 or 11 , for example.
  • the removable medium 171 and the removable medium 321 include magnetic discs (including flexible discs) and optical disc (CD-ROMs and DVDs). Further, the removable medium 171 and the removable medium 321 also include magneto-optical mini discs (MDs), semiconductor memory discs, and the like.
  • the programs can be installed into the storage unit 163 by attaching the removable medium 171 to the drive 165 .
  • the programs can be installed into the storage unit 313 by attaching the removable medium 321 to the drive 315 .
  • the programs can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
  • the programs can be received by the communication unit 164 and installed into the storage unit 163 .
  • the programs can be received by the communication unit 314 and installed into the storage unit 313 .
  • the programs can also be installed in advance in a recording unit, a ROM, or the like.
  • the programs can be installed in advance in the storage unit 163 or the ROM of the SOC 151 .
  • the programs can be installed in advance in the storage unit 313 , the ROM 302 , or the like.
  • the programs to be executed by the computer may be programs to be processed in time series in accordance with the sequence explained herein or may be programs to be processed in parallel or at necessary timing such as upon receipt of an invocation.
  • steps describing the programs to be recorded in a recording medium explained herein include not only processes performed in time series in accordance with the described sequence but also processes that are not necessarily performed in time series but are executed in parallel or individually.
  • the steps described above can be performed in the apparatuses described above or any apparatus other than the apparatuses described above.
  • the apparatuses to perform the steps have functions necessary for performing the steps (functional blocks or the like).
  • the information necessary for performing the steps is transmitted as appropriate to the apparatuses.
  • the system explained herein refers to an assembly of constituent elements (apparatuses, modules (components), and the like). However, all of the constituent elements may not necessarily be in the same housing. Therefore, the system may be composed of a plurality of apparatuses stored in separate housings and connected via a network or one apparatus with a plurality of modules stored in one housing.
  • a configuration explained above as one apparatus (or one processing unit) may be divided into a plurality of apparatuses (or a plurality of processing units).
  • a plurality of apparatuses (or a plurality of processing units) explained above may be collectively configured as one apparatus (or one processing unit).
  • any component other than those described above may be added to the apparatuses (or the processing units).
  • some components of an apparatus (or a processing unit) may be included in another apparatus (or another processing unit) as far as the entire system is configured and operated in substantially the same manner.
  • the present technology can be configured as a cloud computing system in which one function is shared among a plurality of apparatuses via a network and is performed in coordination with one another.
  • one step includes a plurality of processes
  • the plurality of processes included in the one step may be executed by one apparatus or may be shared and executed by a plurality of apparatuses.
  • the present technology is not limited to the foregoing one but may be implemented as any component mounted in such an apparatus or apparatuses constituting a system, for example, a processor as a system large scale integration (LSI), a module using a plurality of processors, a unit using a plurality of modules, a set with still other functions added to the unit (that is, part of the apparatus), or the like.
  • LSI system large scale integration
  • modules using a plurality of processors
  • a unit using a plurality of modules a set with still other functions added to the unit (that is, part of the apparatus), or the like.
  • the present technology can also be configured as follows:
  • An information processing apparatus including:
  • a group formation unit that forms a group for projecting one contents data in cooperation with other information processing apparatuses including projection units to project images and imaging units to shoot a subject and obtain shot images;
  • correction information sharing unit that shares correction information as information relating to correction made to the images projected by the projection units of the information processing apparatuses belonging to the group formed by the group formation unit among the information processing apparatuses belonging to the group formed by the group formation unit;
  • a correction information updating unit that updates the correction information for the subject information processing apparatus on the basis of the shot image obtained by shooting the image projected by the projection unit as a subject and the correction information shared by the correction information sharing unit.
  • correction information includes information relating to correction made to predetermined representative pixels in the image.
  • the information processing apparatus wherein the information relating to correction made to the representative pixels includes coordinates before and after the correction of the representative pixels, the gain and shift values of respective color components of the representative pixels, and a coefficient of color conversion matrix of the representative pixels.
  • the information processing apparatus according to any of (1) to (3), further including a wireless communication unit that performs wireless communications, wherein
  • the group formation unit forms the group including other information processing apparatuses with which wireless communications were performed by the wireless communication unit and the subject information processing apparatus.
  • the information processing apparatus according to any of (1) to (3), wherein the group formation unit forms the group including other information processing apparatuses connected to the subject information processing apparatus via predetermined communication cables and the subject information processing apparatus.
  • the information processing apparatus according to any of (1) to (5), wherein the group formation unit generates group information as information relating to the formed group.
  • the information processing apparatus according to (6), wherein the group information includes identification information for identifying the group and the correction information for the information processing apparatuses constituting the group corresponding to the group information.
  • the information processing apparatus according to (7), wherein the group information further includes information relating to the kinds of contents data that were projected by the group in the past.
  • the information processing apparatus according to (8), wherein the group information further includes the layout of the images projected by the projection units of the information processing apparatuses belonging to the group at the time of projection of the contents data.
  • the information processing apparatus wherein the group information further includes information relating to a projection plane onto which the images were projected.
  • the information processing apparatus according to (9) and (10), further including:
  • a group information sharing unit that allows the group information to be shared among the information processing apparatuses belonging to the group
  • a group information updating unit that updates the group information.
  • the information processing apparatus according to any of (6) to (11), further including a projection position control unit that controls the projection position of the image projected by the projection unit on the basis of the group information and the correction information.
  • the information processing apparatus wherein, when the positions of the images projected by the projection units of the information processing apparatuses belonging to the group are different from positions decided on the basis of the group information and the correction information, the projection position control unit projects guiding images such that the images can be projected into the positions.
  • the information processing apparatus according to any of (6) to (13), further including an image cutout unit that cuts out a portion of the image included in the contents data to be projected by the projection unit on the basis of the group information.
  • the information processing apparatus according to any of (6) to (14), further including an image correction unit that corrects the portion of the image included in the contents data to be projected by the projection unit on the basis of the group information.
  • the information processing apparatus according to any of (1) to (15), further including a group separation unit that separates from the group formed by the group formation unit after notifying the separation from the group to the other information processing apparatuses belonging to the group.
  • the information processing apparatus according to any of (1) to (16), wherein the contents data includes image data and metadata.
  • the information processing apparatus wherein the metadata includes information relating to the contents of the image data, genre, recommended projection image size, type, and resolution.
  • An information processing method including:

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Geometry (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)
US15/319,085 2014-07-01 2015-06-17 Information processing to allow projector units to project images in cooperation Active US9918058B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2014-135793 2014-07-01
JP2014135793 2014-07-01
PCT/JP2015/067424 WO2016002512A1 (ja) 2014-07-01 2015-06-17 情報処理装置および方法

Publications (2)

Publication Number Publication Date
US20170127032A1 US20170127032A1 (en) 2017-05-04
US9918058B2 true US9918058B2 (en) 2018-03-13

Family

ID=55019059

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/319,085 Active US9918058B2 (en) 2014-07-01 2015-06-17 Information processing to allow projector units to project images in cooperation

Country Status (4)

Country Link
US (1) US9918058B2 (zh)
JP (1) JP6917710B2 (zh)
CN (1) CN106464826B (zh)
WO (1) WO2016002512A1 (zh)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190371276A1 (en) * 2018-06-05 2019-12-05 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
US20200053330A1 (en) * 2017-03-09 2020-02-13 Sony Corporation Image processing apparatus and method
US10917620B1 (en) * 2019-08-21 2021-02-09 Delta Electronics, Inc. Projection apparatus, projection system, and operation method
US11187923B2 (en) 2017-12-20 2021-11-30 Magic Leap, Inc. Insert for augmented reality viewing device
US11263999B2 (en) 2017-06-08 2022-03-01 Canon Kabushiki Kaisha Image processing device and control method therefor
US11343477B2 (en) * 2018-05-31 2022-05-24 Goertek Inc. Method and apparatus for correcting color convergence error, and device
US11347960B2 (en) 2015-02-26 2022-05-31 Magic Leap, Inc. Apparatus for a near-eye display
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US11521296B2 (en) 2018-11-16 2022-12-06 Magic Leap, Inc. Image size triggered clarification to maintain image sharpness
US11579441B2 (en) 2018-07-02 2023-02-14 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11598651B2 (en) 2018-07-24 2023-03-07 Magic Leap, Inc. Temperature dependent calibration of movement detection devices
US11609645B2 (en) 2018-08-03 2023-03-21 Magic Leap, Inc. Unfused pose-based drift correction of a fused pose of a totem in a user interaction system
US11624929B2 (en) 2018-07-24 2023-04-11 Magic Leap, Inc. Viewing device with dust seal integration
US11630507B2 (en) 2018-08-02 2023-04-18 Magic Leap, Inc. Viewing system with interpupillary distance compensation based on head motion
US11737832B2 (en) 2019-11-15 2023-08-29 Magic Leap, Inc. Viewing system for use in a surgical environment
US11762623B2 (en) 2019-03-12 2023-09-19 Magic Leap, Inc. Registration of local content between first and second augmented reality viewers
US11776509B2 (en) 2018-03-15 2023-10-03 Magic Leap, Inc. Image correction due to deformation of components of a viewing device
US11790554B2 (en) 2016-12-29 2023-10-17 Magic Leap, Inc. Systems and methods for augmented reality
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
US11874468B2 (en) 2016-12-30 2024-01-16 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
US11885871B2 (en) 2018-05-31 2024-01-30 Magic Leap, Inc. Radar head pose localization
US11927759B2 (en) 2017-07-26 2024-03-12 Magic Leap, Inc. Exit pupil expander
US11953653B2 (en) 2017-12-10 2024-04-09 Magic Leap, Inc. Anti-reflective coatings on optical waveguides
US12001013B2 (en) 2023-01-09 2024-06-04 Magic Leap, Inc. Pixel intensity modulation using modifying gain values

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2614650A1 (en) 2010-09-10 2013-07-17 Lemoptix SA A device for projecting an image
US20170272716A1 (en) * 2016-03-15 2017-09-21 Casio Computer Co., Ltd. Projection apparatus, projection control method, and storage medium
US10205920B2 (en) 2016-03-28 2019-02-12 Maxell, Ltd. Projection video display apparatus with variable light adjustment for multi-screen projection mode
JP2018084751A (ja) * 2016-11-25 2018-05-31 キヤノン株式会社 表示装置
US11182875B2 (en) * 2017-05-23 2021-11-23 Koninklijke Kpn N.V. Coordinate mapping for rendering panoramic scene
TWI674441B (zh) * 2017-11-02 2019-10-11 天衍互動股份有限公司 光雕傳媒系統及其方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040184011A1 (en) * 2003-03-21 2004-09-23 Ramesh Raskar Self-configurable ad-hoc projector cluster
JP2006114948A (ja) 2004-10-12 2006-04-27 Hitachi Ltd 色順次方式投射型映像表示装置
JP2008249906A (ja) 2007-03-29 2008-10-16 Brother Ind Ltd プロジェクタ及び表示システム
JP2012027154A (ja) 2010-07-21 2012-02-09 Canon Inc 画像表示システム
US20120050698A1 (en) * 2010-08-25 2012-03-01 Canon Kabushiki Kaisha Projection system
JP2012517621A (ja) 2009-02-11 2012-08-02 ヒューレット−パッカード デベロップメント カンパニー エル．ピー． マルチプロジェクタシステム及び方法
US20130176351A1 (en) * 2010-09-10 2013-07-11 Lemoptix Sa Device for projecting an image

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5495572B2 (ja) * 2009-01-07 2014-05-21 キヤノン株式会社 プロジェクタ・システム及びこれを含むビデオ会議システム
JP5725724B2 (ja) * 2010-04-01 2015-05-27 キヤノン株式会社 投影装置
JP2012118390A (ja) * 2010-12-02 2012-06-21 Sharp Corp 表示装置およびマルチディスプレイシステム

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040184011A1 (en) * 2003-03-21 2004-09-23 Ramesh Raskar Self-configurable ad-hoc projector cluster
JP2006114948A (ja) 2004-10-12 2006-04-27 Hitachi Ltd 色順次方式投射型映像表示装置
JP2008249906A (ja) 2007-03-29 2008-10-16 Brother Ind Ltd プロジェクタ及び表示システム
JP2012517621A (ja) 2009-02-11 2012-08-02 ヒューレット−パッカード デベロップメント カンパニー エル．ピー． マルチプロジェクタシステム及び方法
JP2012027154A (ja) 2010-07-21 2012-02-09 Canon Inc 画像表示システム
US20120050698A1 (en) * 2010-08-25 2012-03-01 Canon Kabushiki Kaisha Projection system
US20130176351A1 (en) * 2010-09-10 2013-07-11 Lemoptix Sa Device for projecting an image

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Raskar, et al., "iLamps: Geometrically Aware and Self-Configuring Projectors", ACM SIGGRAPH 2003 Conference Proceedings, Jul. 27-31, 2003, pp. 1-10.

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11756335B2 (en) 2015-02-26 2023-09-12 Magic Leap, Inc. Apparatus for a near-eye display
US11347960B2 (en) 2015-02-26 2022-05-31 Magic Leap, Inc. Apparatus for a near-eye display
US11790554B2 (en) 2016-12-29 2023-10-17 Magic Leap, Inc. Systems and methods for augmented reality
US11874468B2 (en) 2016-12-30 2024-01-16 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
US11601626B2 (en) * 2017-03-09 2023-03-07 Sony Corporation Image processing apparatus and method
US20200053330A1 (en) * 2017-03-09 2020-02-13 Sony Corporation Image processing apparatus and method
US11263999B2 (en) 2017-06-08 2022-03-01 Canon Kabushiki Kaisha Image processing device and control method therefor
US11927759B2 (en) 2017-07-26 2024-03-12 Magic Leap, Inc. Exit pupil expander
US11953653B2 (en) 2017-12-10 2024-04-09 Magic Leap, Inc. Anti-reflective coatings on optical waveguides
US11187923B2 (en) 2017-12-20 2021-11-30 Magic Leap, Inc. Insert for augmented reality viewing device
US11762222B2 (en) 2017-12-20 2023-09-19 Magic Leap, Inc. Insert for augmented reality viewing device
US11908434B2 (en) 2018-03-15 2024-02-20 Magic Leap, Inc. Image correction due to deformation of components of a viewing device
US11776509B2 (en) 2018-03-15 2023-10-03 Magic Leap, Inc. Image correction due to deformation of components of a viewing device
US11343477B2 (en) * 2018-05-31 2022-05-24 Goertek Inc. Method and apparatus for correcting color convergence error, and device
US11885871B2 (en) 2018-05-31 2024-01-30 Magic Leap, Inc. Radar head pose localization
US10825424B2 (en) * 2018-06-05 2020-11-03 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
US11200870B2 (en) 2018-06-05 2021-12-14 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
US20190371276A1 (en) * 2018-06-05 2019-12-05 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
US11579441B2 (en) 2018-07-02 2023-02-14 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
US11598651B2 (en) 2018-07-24 2023-03-07 Magic Leap, Inc. Temperature dependent calibration of movement detection devices
US11624929B2 (en) 2018-07-24 2023-04-11 Magic Leap, Inc. Viewing device with dust seal integration
US11630507B2 (en) 2018-08-02 2023-04-18 Magic Leap, Inc. Viewing system with interpupillary distance compensation based on head motion
US11609645B2 (en) 2018-08-03 2023-03-21 Magic Leap, Inc. Unfused pose-based drift correction of a fused pose of a totem in a user interaction system
US11960661B2 (en) 2018-08-03 2024-04-16 Magic Leap, Inc. Unfused pose-based drift correction of a fused pose of a totem in a user interaction system
US11521296B2 (en) 2018-11-16 2022-12-06 Magic Leap, Inc. Image size triggered clarification to maintain image sharpness
US11762623B2 (en) 2019-03-12 2023-09-19 Magic Leap, Inc. Registration of local content between first and second augmented reality viewers
US10917620B1 (en) * 2019-08-21 2021-02-09 Delta Electronics, Inc. Projection apparatus, projection system, and operation method
US11737832B2 (en) 2019-11-15 2023-08-29 Magic Leap, Inc. Viewing system for use in a surgical environment
US12001013B2 (en) 2023-01-09 2024-06-04 Magic Leap, Inc. Pixel intensity modulation using modifying gain values

Also Published As

Publication number Publication date
CN106464826B (zh) 2020-02-07
JPWO2016002512A1 (ja) 2017-04-27
JP6917710B2 (ja) 2021-08-11
CN106464826A (zh) 2017-02-22
US20170127032A1 (en) 2017-05-04
WO2016002512A1 (ja) 2016-01-07

Similar Documents

Publication Publication Date Title
US9918058B2 (en) Information processing to allow projector units to project images in cooperation
US11032490B2 (en) Camera array including camera modules
US10665261B2 (en) Camera array including camera modules
US9792712B2 (en) Computational pipeline and architecture for multi-view displays
JP6768197B2 (ja) 情報処理装置および方法
EP3442222B1 (en) System for projecting immersive audiovisual content
US10303419B2 (en) Information processing system, display processing apparatus, display processing method, and recording medium
US9509907B2 (en) Information processing device, storage medium having moving image data stored thereon, information processing system, storage medium having moving image reproduction program stored thereon, and moving image reproduction method
CN103543596A (zh) 一种多面投影系统
KR20180102125A (ko) 영상 표시 시스템
CN110537208B (zh) 头戴式显示器和方法
JP2023027044A (ja) クラウド制御システム
CN114651448A (zh) 信息处理系统、信息处理方法和程序
CN114268775A (zh) 投影系统、方法及存储介质
US20220377349A1 (en) Image data transfer apparatus and image compression
JP2014142467A (ja) 画像出力装置及びその制御方法、システム、プログラム、並びに記憶媒体
US11935157B2 (en) Image processing system, image processing method, and storage medium
US20200225467A1 (en) Method for projecting immersive audiovisual content
WO2016190193A1 (ja) 情報処理装置、出力制御装置、情報処理システム、および動画データ出力方法
JP2020030223A (ja) 連携表示システム
US11388378B2 (en) Image processing apparatus, image processing method and projection system
WO2016039155A1 (ja) 画像処理システム、画像処理方法、プログラム及び情報記憶媒体
CN114339174B (zh) 一种投影设备及其控制方法
US20240179327A1 (en) Virtual reality streaming system and method
US20230037102A1 (en) Information processing system, information processing method, and program

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAKAHASHI, NAOMASA;KOBAYASHI, NAOKI;REEL/FRAME:040980/0496

Effective date: 20161019

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4