WO2023100573A1 - 制御装置、制御方法、及び制御プログラム - Google Patents

制御装置、制御方法、及び制御プログラム Download PDF

Info

Publication number
WO2023100573A1
WO2023100573A1 PCT/JP2022/040695 JP2022040695W WO2023100573A1 WO 2023100573 A1 WO2023100573 A1 WO 2023100573A1 JP 2022040695 W JP2022040695 W JP 2022040695W WO 2023100573 A1 WO2023100573 A1 WO 2023100573A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
image data
control device
projection
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/040695
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
和紀 井上
一樹 石田
真彦 宮田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to JP2023564818A priority Critical patent/JPWO2023100573A1/ja
Publication of WO2023100573A1 publication Critical patent/WO2023100573A1/ja
Priority to US18/676,895 priority patent/US20240312164A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/66—Transforming electric information into light information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/315—Modulator illumination systems
    • H04N9/3152—Modulator illumination systems for shaping the light beam
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141—Constructional details thereof
    • H04N9/317—Convergence or focusing systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to a control device, control method, and control program.
  • Patent Document 1 an image of a position marker used for specifying the display position of a virtual object in augmented reality technology is acquired, and the image for projection mapping is completed by incorporating it into the image for projection mapping.
  • a video production device is described in which the video is projected toward a showroom by a video projection device, and an image of a position marker is displayed on the floor of the showroom.
  • Patent Literature 2 in projection mapping in which video content is projected onto a three-dimensional object by a projector, taking into consideration the three-dimensional structure of the three-dimensional object, when the user shoots video content with a camera mounted on a smart device, It is described that the AR content is superimposed and displayed in the video.
  • One embodiment according to the technology of the present disclosure provides a control device, control method, and control program capable of giving notification regarding specific content associated with a display image.
  • a control device of one aspect of the present invention is a control device comprising a processor, wherein the processor generates third image data based on first image data and second image data, and outputs the third image data. and, of the third images represented by the third image data, the second image based on the second image data is an image indicating that specific content is associated with the third image, It surrounds the first image based on the first image data among the third images.
  • a control device is a control device including a processor, the processor generates third image data based on first image data and second image data, and outputs the third image data. , the second image based on the second image data among the third images represented by the third image data is included in the first image based on the first image data among the third images, specific content is an image indicating the position of the image of the first object associated with .
  • a control method of one aspect of the present invention includes a processor of a control device generating third image data based on first image data and second image data, outputting the third image data, is an image indicating that specific content is associated with the third image, and the second image based on the second image data among the third images represented by It surrounds a first image based on the first image data.
  • a control method of one aspect of the present invention includes a processor of a control device generating third image data based on first image data and second image data, outputting the third image data, A second image based on the second image data among the third images represented by is associated with specific content included in the first image based on the first image data among the third images. It is an image showing the position of the image of one object.
  • a control program causes a processor of a control device to generate third image data based on first image data and second image data, and output the third image data. wherein the second image based on the second image data among the third images represented by the third image data indicates that specific content is associated with the third image An image surrounding a first image based on the first image data among the third images.
  • a control program causes a processor of a control device to generate third image data based on first image data and second image data, and output the third image data.
  • the second image based on the second image data among the third images represented by the third image data is the first image based on the first image data among the third images
  • the included image indicates the position of the image of the first object associated with the specific content.
  • control device capable of notifying specific content associated with a display image.
  • FIG. 1 is a diagram showing an example of a projection system 100 according to Embodiment 1;
  • FIG. 1 is a diagram showing an example of a configuration of a projection device 10;
  • FIG. 2 is a schematic diagram showing an example of an internal configuration of a projection unit 1;
  • FIG. 1 is a diagram illustrating an example of an external configuration of a projection device 10;
  • FIG. 5 is a schematic partial cross-sectional view of an optical unit 106 of the projection device 10 shown in FIG. 4.
  • FIG. 3 is a diagram showing an example of a hardware configuration of an information terminal 80;
  • FIG. FIG. 2 illustrates an example of image projection and playback of augmented reality content;
  • FIG. 4 is a diagram showing another example of projection by the projection device 10 and reproduction of augmented reality content.
  • FIG. 1 is a diagram showing an example of a projection system 100 according to Embodiment 1;
  • FIG. 1 is a diagram showing an example of a configuration of a projection device 10;
  • FIG. 2 is
  • FIG. 10 is a diagram showing an example of inputting information on a projection area
  • FIG. 4 is a diagram showing an example of image projection and augmented reality content reproduction based on input of projection area information
  • 6 is a diagram showing an example of a frame image 60 including identification information
  • FIG. 5 is a diagram showing an example of guidance for the direction of a vehicle image 51A based on identification information 61.
  • FIG. FIG. 2 is a diagram (part 1) showing an example of reproduction of augmented reality content according to attributes of the augmented reality content
  • FIG. 2 is a diagram (part 2) showing an example of reproduction of augmented reality content according to attributes of the augmented reality content
  • FIG. 6 is a diagram showing an example of a frame image 60A showing the position of the image of the first object associated with the augmented reality content
  • FIG. 11 is a diagram (part 1) showing an example of tracking of the frame image 60A when the image of the first object moves
  • FIG. 12 is a diagram (part 2) showing an example of tracking of the frame image 60A when the image of the first object moves
  • FIG. 10 is a diagram (Part 1) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle image 51
  • FIG. 9 is a diagram (part 2) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle image 51
  • FIG. 10 is a diagram (Part 1) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle image 51
  • FIG. 9 is a diagram (part 2) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle
  • FIG. 12 is a diagram (part 3) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle image 51;
  • FIG. 14 is a diagram (part 4) showing a specific example of the frame image 60A based on the information of the display area and the position of the vehicle image 51;
  • 3 is a schematic diagram showing another external configuration of the projection device 10.
  • FIG. 23 is a schematic cross-sectional view of the optical unit 106 of the projection device 10 shown in FIG. 22.
  • FIG. 1 is a diagram showing an example of a projection system 100 according to Embodiment 1.
  • projection system 100 includes projection device 10 and information terminal 80 .
  • a control device according to the present invention is applied to the projection device 10, for example.
  • the projection device 10 is a projection device capable of projecting onto the projection target 6 .
  • the projection target 6 is an object such as a screen having a projection surface on which a projection image is displayed by the projection device 10 .
  • the projection plane of the projection target 6 is a rectangular plane. Assume that the top, bottom, left, and right of the projection object 6 in FIG. 1 are the top, bottom, left, and right of the actual projection object 6 .
  • a projection range 11 indicated by a dashed line is a region of the projection target 6 that is irradiated with projection light by the projection device 10 .
  • the projection range 11 is part or all of the projectable range that can be projected by the projection device 10 .
  • the projection range 11 is rectangular.
  • the information terminal 80 is an information terminal, such as a smartphone or a tablet terminal, that has an imaging unit (for example, the imaging module 85 in FIG. 6) and a display unit 86 .
  • an imaging unit for example, the imaging module 85 in FIG. 6
  • the information terminal 80 displays a superimposed image in which predetermined Augmented Reality (AR) content is superimposed on the captured image.
  • An application to be displayed by the unit 86 is stored (installed).
  • FIG. 2 is a diagram showing an example of the configuration of the projection device 10.
  • the projection device 10 includes, for example, a projection section 1, a control device 4, and an operation reception section 2.
  • the projection device 10 may further include a communication section 5 .
  • the projection unit 1 is configured by, for example, a liquid crystal projector or a projector using LCOS (Liquid Crystal On Silicon). In the following description, it is assumed that the projection unit 1 is a liquid crystal projector.
  • LCOS Liquid Crystal On Silicon
  • the control device 4 is an example of the control device of the present invention.
  • the control device 4 controls projection by the projection device 10 .
  • the control device 4 includes a control unit configured by various processors, a communication interface (not shown) for communicating with each unit, and a storage medium such as a hard disk, SSD (Solid State Drive), or ROM (Read Only Memory). 4a, and controls the projection unit 1 in an integrated manner.
  • various processors of the control unit of the control device 4 the circuit configuration is changed after manufacturing such as CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), which is a general-purpose processor that executes programs and performs various processes.
  • Programmable Logic Device which is a processor, or dedicated electric circuit, etc., which is a processor having a circuit configuration specially designed to execute specific processing such as ASIC (Application Specific Integrated Circuit) is included.
  • ASIC Application Specific Integrated Circuit
  • the control unit of the control device 4 may be composed of one of various processors, or a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs or a combination of a CPU and an FPGA). may consist of
  • the operation reception unit 2 detects instructions from the user (user instructions) by receiving various operations from the user.
  • the operation reception unit 2 may be a button, key, joystick, or the like provided on the control device 4 , or may be a reception unit or the like that receives a signal from a remote controller that remotely operates the control device 4 .
  • the communication unit 5 is a communication interface capable of communicating with other devices.
  • the communication unit 5 may be a wired communication interface that performs wired communication, or a wireless communication interface that performs wireless communication.
  • the projection unit 1, the control device 4, the operation reception unit 2, and the communication unit 5 are realized by one device, for example (see FIGS. 4 and 5, for example).
  • the projection unit 1, the control device 4, the operation reception unit 2, and the communication unit 5 may be realized by a plurality of devices that can cooperate by communicating with each other.
  • FIG. 3 is a schematic diagram showing an example of the internal configuration of the projection unit 1.
  • the projection unit 1 of the projection device 10 shown in FIG. 2 includes a light source 21, a light modulation unit 22, a projection optical system 23, and a control circuit 24, as shown in FIG.
  • the light source 21 includes a light-emitting element such as a laser or an LED (Light Emitting Diode), and emits white light, for example.
  • the light modulation unit 22 modulates each color light emitted from the light source 21 and separated into three colors of red, blue, and green by a color separation mechanism (not shown) based on image information, and outputs each color image. It is composed of a liquid crystal panel (light modulation element) and a dichroic prism that mixes the respective color images emitted from the three liquid crystal panels and emits them in the same direction. Red, blue, and green filters may be mounted on these three liquid crystal panels, respectively, and the white light emitted from the light source 21 may be modulated by each liquid crystal panel to emit an image of each color.
  • the projection optical system 23 receives the light from the light source 21 and the light modulation section 22, and includes at least one lens and is configured by, for example, a relay optical system. The light that has passed through the projection optical system 23 is projected onto the projection object 6 .
  • a region of the projection object 6 irradiated with light that passes through the entire range of the light modulation unit 22 is a projectable range that can be projected by the projection unit 1 .
  • the projection range 11 of the projection section 1 is the area irradiated with the light actually transmitted from the light modulation section 22 in this projectable range. For example, by controlling the size, position, and shape of the light-transmitting region of the light modulation section 22, the size, position, and shape of the projection range of the projection section 1 change within the projectable range.
  • the control circuit 24 controls the light source 21, the light modulating unit 22, and the projection optical system 23 based on the display data input from the control device 4, so that an image based on the display data is projected onto the projection object 6. be projected.
  • the display data to be input to the control circuit 24 is composed of red display data, blue display data, and green display data.
  • control circuit 24 expands or reduces the projection range of the projection unit 1 by changing the projection optical system 23 based on commands input from the control device 4 .
  • control device 4 may move the projection range of the projection unit 1 by changing the projection optical system 23 based on the user's operation received by the operation reception unit 2 .
  • the projection device 10 also includes a shift mechanism that mechanically or optically moves the projection range of the projection unit 1 while maintaining the image circle of the projection optical system 23 .
  • the image circle of the projection optical system 23 is an area in which the projection light incident on the projection optical system 23 passes through the projection optical system 23 properly in terms of light falloff, color separation, peripheral curvature, and the like.
  • the shift mechanism is realized by at least one of an optical system shift mechanism that performs optical system shift and an electronic shift mechanism that performs electronic shift.
  • the optical system shift mechanism is, for example, a mechanism for moving the projection optical system 23 in a direction perpendicular to the optical axis (see, for example, FIGS. 5 and 23), or a mechanism for shifting the light modulation section 22 instead of moving the projection optical system 23. It is a mechanism that moves in the direction perpendicular to the axis. Further, the optical system shift mechanism may combine the movement of the projection optical system 23 and the movement of the light modulation section 22 .
  • the electronic shift mechanism is a mechanism that shifts the pseudo projection range by changing the light transmission range in the light modulation section 22 .
  • the projection device 10 may also include a projection direction changing mechanism that moves the projection range together with the image circle of the projection optical system 23 .
  • the projection direction changing mechanism is a mechanism that changes the projection direction of the projection unit 1 by changing the orientation of the projection unit 1 by mechanical rotation (see FIG. 23, for example).
  • FIG. 4 is a diagram showing an example of the external configuration of the projection device 10.
  • FIG. 5 is a schematic partial cross-sectional view of the optical unit 106 of the projection device 10 shown in FIG. FIG. 5 shows a cross section along the optical path of light emitted from the main body 101 shown in FIG.
  • the projection device 10 includes a main body 101 and an optical unit 106 protruding from the main body 101 .
  • the operation reception section 2 , the control device 4 , the light source 21 , the light modulation section 22 and the control circuit 24 in the projection section 1 , and the communication section 5 are provided in the main body section 101 .
  • a projection optical system 23 in the projection unit 1 is provided in the optical unit 106 .
  • the optical unit 106 includes a first member 102 supported by the body portion 101 .
  • the optical unit 106 may be detachably attached to the main body 101 (in other words, replaceable).
  • the main body 101 has a housing 15 in which an opening 15a for passing light is formed in a portion connected to the optical unit 106. As shown in FIG. 5, the main body 101 has a housing 15 in which an opening 15a for passing light is formed in a portion connected to the optical unit 106. As shown in FIG. 5, the main body 101 has a housing 15 in which an opening 15a for passing light is formed in a portion connected to the optical unit 106. As shown in FIG.
  • a light source 21 inside the housing 15 of the main unit 101 are a light source 21 and a light modulation unit 22 ( (see FIG. 3) is provided.
  • the light emitted from the light source 21 enters the light modulating section 22 of the light modulating unit 12, is spatially modulated by the light modulating section 22, and is emitted.
  • an image formed by light spatially modulated by the light modulation unit 12 passes through the opening 15a of the housing 15, enters the optical unit 106, is projected onto the projection object 6,
  • the image G1 becomes visible to the observer.
  • the optical unit 106 includes a first member 102 having a hollow portion 2A connected to the inside of the body portion 101, a first optical system 121 arranged in the hollow portion 2A, a lens 34, a first and a shift mechanism 105 .
  • the first member 102 is, for example, a member having a rectangular cross-sectional outline, and the opening 2a and the opening 2b are formed on planes parallel to each other.
  • the first member 102 is supported by the body portion 101 with the opening 2a arranged at a position facing the opening 15a of the body portion 101 .
  • Light emitted from the light modulating portion 22 of the light modulating unit 12 of the main body portion 101 enters the hollow portion 2A of the first member 102 through the openings 15a and 2a.
  • the incident direction of light entering the hollow portion 2A from the main body portion 101 is described as the direction X1, the direction opposite to the direction X1 is described as the direction X2, and the directions X1 and X2 are collectively described as the direction X.
  • the direction from the front to the back of the paper surface and the opposite direction are described as a direction Z.
  • the direction from the front to the back of the paper is described as a direction Z1
  • the direction from the back to the front of the paper is described as a direction Z2.
  • a direction perpendicular to the direction X and the direction Z is described as a direction Y.
  • the upward direction in FIG. 5 is described as a direction Y1
  • the downward direction in FIG. 5 is described as a direction Y2.
  • the projection device 10 is arranged such that the direction Y2 is the vertical direction.
  • the projection optical system 23 shown in FIG. 3 is composed of the first optical system 121 and the lens 34 in the example of FIG.
  • the optical axis K of this projection optical system 23 is shown in FIG.
  • the first optical system 121 and the lens 34 are arranged along the optical axis K in this order from the light modulation section 22 side.
  • the first optical system 121 includes at least one lens, and guides the light incident on the first member 102 from the main body 101 and traveling in the direction X1 to the lens 34 .
  • the lens 34 is arranged at the end of the first member 102 so as to block the opening 2b formed at the end of the first member 102 on the direction X1 side.
  • the lens 34 projects the light incident from the first optical system 121 onto the projection object 6 .
  • the first shift mechanism 105 is a mechanism for moving the optical axis K of the projection optical system (in other words, the optical unit 106) in a direction perpendicular to the optical axis K (direction Y in FIG. 5). Specifically, the first shift mechanism 105 is configured to change the position of the first member 102 in the direction Y with respect to the body portion 101 .
  • the first shift mechanism 105 may be one that moves the first member 102 manually, or one that moves the first member 102 electrically.
  • FIG. 5 shows a state in which the first member 102 has been moved to the maximum extent in the direction Y1 by the first shift mechanism 105. As shown in FIG. The first member 102 is moved in the direction Y2 by the first shift mechanism 105 from the state shown in FIG. , the image G1 projected onto the projection object 6 can be shifted (translated) in the direction Y2.
  • the first shift mechanism 105 may be a mechanism that moves the light modulation section 22 in the Y direction instead of moving the optical unit 106 in the Y direction. Even in this case, the image G1 projected onto the projection target 6 can be moved in the Y direction.
  • FIG. 6 is a diagram showing an example of the hardware configuration of the information terminal 80.
  • the information terminal 80 shown in FIG. 1 includes a processor 81, a memory 82, a communication interface 83, a user interface 84, and an imaging module 85, as shown in FIG.
  • Processor 81 , memory 82 , communication interface 83 , user interface 84 and imaging module 85 are connected by bus 89 , for example.
  • the processor 81 is a circuit that performs signal processing, such as a CPU that controls the entire information terminal 80 .
  • the processor 81 may be realized by other digital circuits such as FPGA and DSP (Digital Signal Processor). Also, the processor 81 may be realized by combining a plurality of digital circuits.
  • the memory 82 includes, for example, main memory and auxiliary memory.
  • the main memory is, for example, RAM (Random Access Memory).
  • the main memory is used as a work area for processor 81 .
  • Auxiliary memory is non-volatile memory such as magnetic disk, optical disk, flash memory, etc.
  • Various programs for operating the information terminal 80 are stored in the auxiliary memory. Programs stored in the auxiliary memory are loaded into the main memory and executed by the processor 81 .
  • the auxiliary memory may include a portable memory removable from the information terminal 80.
  • Portable memories include memory cards such as USB (Universal Serial Bus) flash drives and SD (Secure Digital) memory cards, and external hard disk drives.
  • the communication interface 83 is a communication interface for communicating with an external device of the information terminal 80 .
  • Communication interface 83 is controlled by processor 81 .
  • the communication interface 83 may be a wired communication interface that performs wired communication, a wireless communication interface that performs wireless communication, or may include both a wired communication interface and a wireless communication interface.
  • the user interface 84 includes, for example, an input device that receives operation input from the user and an output device that outputs information to the user.
  • the input device can be implemented by, for example, a pointing device (eg mouse), a key (eg keyboard), a remote controller, or the like.
  • An output device can be realized by, for example, a display or a speaker. Also, the input device and the output device may be implemented by a touch panel or the like.
  • User interface 84 is controlled by processor 81 .
  • the display unit 86 of the information terminal 80 shown in FIG. 1 is realized by a touch panel included in the user interface 84, for example.
  • the imaging module 85 is an imaging unit including an imaging lens and an imaging element.
  • the imaging element for example, a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor can be used.
  • FIG. 7 is a diagram illustrating an example of image projection and playback of augmented reality content.
  • First image data representing a projection target image 50 is input to the projection device 10 .
  • the projection target image 50 is an image including a car image 51, which is a photographic image or an illustration image of a sports car.
  • the projection device 10 stores the second image data representing the frame image 60 in the storage medium 4a.
  • the frame image 60 is a hollow rectangular frame image.
  • the control device 4 of the projection device 10 generates third image data representing the projection image 70 based on the first image data and the second image data. Then, the control device 4 outputs the generated third image data to the projection section 1 of the projection device 10 . Thereby, the projection image 70 based on the third image data is projected onto the projection range 11 .
  • the projected image 70 is an example of a third image represented by third image data.
  • the projection image 70 is an image in which the projection target image 50 is superimposed inside the frame image 60, which is a hollow rectangular frame image.
  • the projection image 70 includes a projection target image 50A and a frame image 60A.
  • the projection target image 50A is the first image in the projection image 70 based on the first image data.
  • the vehicle image 51A is an image based on the vehicle image 51 in the projection target image 50A.
  • the projection image 70 is generated such that the projection target image 50 is included inside the frame image 60 as it is, so the projection target image 50A is the same as the projection target image 50.
  • the projected image 70 is not limited to this. It may be substituted.
  • the projection target image 50A in the projection image 70 is the projection target image 50 excluding the peripheral region of the projection target image 50 .
  • the frame image 60A is the second image in the projection image 70 based on the second image data.
  • the frame image 60A is the same as the frame image 60 because the projection image 70 is generated such that the frame image 60 is included outside the projection target image 50 as it is.
  • the imaging range 85 a indicates the imaging range of the imaging module 85 of the information terminal 80 . That is, a captured image representing the imaging range 85a is obtained by imaging with the imaging module 85 of the information terminal 80 .
  • the information terminal 80 displays the captured image and a superimposed image in which the glossy image 91 is superimposed on a specific portion of the vehicle image 51A in the image. 90 is stored (installed).
  • the information terminal 80 captures the entire projected image 70 , and the display unit 86 displays a superimposed image 90 in which the glossy image 91 is superimposed on the vehicle image 51A portion of the projected image 70 .
  • the frame image 60A is an image showing that the augmented reality content is associated with the projected image 70.
  • Augmented reality content is one example of specific content.
  • the user of the information terminal 80 is notified in advance that the augmented reality content will be reproduced when the image surrounded by the frame image 60A among the images projected onto the projection object 6 is captured.
  • the user of the information terminal 80 sees the frame image 60A of the projection image 70 projected from the projection device 10, recognizes that the augmented reality content is associated with the projection image 70, and displays the projection image 70 using the information terminal 80. is imaged. As a result, a superimposed image 90 in which the glossy image 91 is superimposed on the projected image 70 is displayed by the display section 86 .
  • the frame image 60A is arranged so as to be in contact with at least part of the outer periphery of the projection target image 50A (first image) and not include the internal region of the projection target image 50A.
  • the perimeter is the edge with no width.
  • the frame image 60A surrounds the projection target image 50A so as to be in contact with the entire periphery of the projection target image 50A.
  • the frame image 60A only needs to surround the projection target image 50A, and does not have to be in contact with the projection target image 50A.
  • the projection image 70 may be an image in which the frame image 60A is arranged so as to surround the projection target image 50A with a slight gap between it and the projection target image 50A.
  • Surrounding the projection target image 50A also includes sandwiching the projection target image 50A, as in the example of FIG. 8, for example.
  • FIG. 8 is a diagram showing another example of projection by the projection device 10 and reproduction of augmented reality content.
  • the frame image 60 is two L-shaped frame images.
  • the projection image 70 is an image in which the frame image 60 is superimposed so as to contact the upper right corner and the lower left corner of the rectangular projection target image 50 . That is, in the projection image 70, the frame image 60A surrounds the projection target image 50A so as to be in contact with a part of the periphery of the projection target image 50A.
  • FIG. 9 is a diagram showing an example of inputting information on a projection area.
  • FIG. 10 is a diagram showing an example of image projection and reproduction of augmented reality content based on input of projection area information.
  • a projection area 6a in FIGS. 9 and 10 is a projection plane of the projection object 6. As shown in FIG. In the example of FIG. 9, the projection area 6a is L-shaped instead of rectangular.
  • the control device 4 of the projection device 10 may receive input of information on the shape of the projection area 6 a of the projection target 6 .
  • the projection area 6a is an example of a display area in which a projection image 70 (third image) is displayed. Input of information on the shape of the projection area 6a is performed via the operation reception unit 2, for example.
  • the projection device 10 stores information indicating the width, color, etc. of the frame as the second image data for generating the frame image 60 in the storage medium 4a.
  • the second image data is not limited to image data representing the predetermined frame image 60, and may be data such as the color and width of the frame image for generating the frame image 60.
  • the control device 4 receives input information about the shape of the projection area 6a, first image data representing the projection target image 50, second image data representing the width and color of the frame, and so on. to generate the third image data based on Specifically, the control device 4 generates the frame image 60 having the width and color indicated by the second image data along the shape of the projection area 6a indicated by the input information. Then, the control device 4 generates third image data representing a projection image 70 in which the projection target image 50 is superimposed inside the frame image 60 , and outputs the generated third image data to the projection section 1 .
  • a projection image 70 having a shape that matches the projection area 6 a of the projection object 6 is projected onto the projection object 6 from the projection device 10 .
  • the control device 4 may generate the frame image 60 based on the color of the input first image data (projection target image 50). For example, the control device 4 may determine the color of a portion (peripheral region) adjacent to the outer periphery of the projection target image 50 in the projection target image 50, and generate the frame image 60 having a color different from the determined color.
  • an application for displaying a superimposed image 90 in which a glossy image 91 is superimposed on a specific portion of the vehicle image 51 in the image is stored in the information terminal 80 together with the captured image.
  • the configuration in which the augmented reality content is associated with the vehicle image 51A (projection target image 50) has been described, but the configuration is not limited to this.
  • the frame image 60 (second image) may be associated with the augmented reality content.
  • the application stored in the information terminal 80 displays a specific position inside the frame image 60 (of the vehicle image 51A) in the image together with the captured image.
  • (Part) may be configured to display a superimposed image 90 in which a glossy image 91 is superimposed.
  • the application stored in the information terminal 80 can extract the frame image based on the shape of the part of the frame image 60.
  • a superimposed image 90 in which the glossy image 91 is superimposed on the specific position may be displayed.
  • FIG. 11 is a diagram showing an example of a frame image 60 containing identification information.
  • the frame image 60 may include the identification information 61 as shown in FIG.
  • the identification information 61 is a plurality of different images arranged at a plurality of positions of the frame image 60 .
  • 20 pieces of identification information 61 are arranged in the frame image 60 at intervals, and in FIG. are doing.
  • the identification information 61 is an example of identification information that can specify the relative position of the identification information 61 in the projection image 70 based on the frame image 60 .
  • the 20 pieces of identification information 61 shown in FIG. 11 are, for example, mutually different one-dimensional codes and two-dimensional codes, and the arrangement of the 20 pieces of identification information 61 in the frame image 60 is predetermined.
  • the information terminal 80 can determine the position of the identification information 61 in the projection image 70 for each piece of identification information 61 included in the captured image, that is, the relative position of the identification information 61 in the projection image 70 . can be located.
  • the information terminal 80 adds gloss to the captured image based on the identification information 61 included in the portion of the frame image 60A.
  • a superimposed image 90 on which the image 91 is superimposed can be displayed.
  • the identification information 61 is not limited to a one-dimensional code or a two-dimensional code, and may be an image having a predetermined specific color or pattern, or an image of characters, numbers, symbols, or the like. may
  • the information terminal 80 can be used, for example, when the vehicle image 51A is not included in the captured image, or when the vehicle image is not included in the captured image.
  • a superimposed image 90 in which the glossy image 91 is superimposed on the captured image may be displayed.
  • FIG. 12 is a diagram showing an example of guidance for the direction of the vehicle image 51A based on the identification information 61.
  • the vehicle image 51A of the projection target image 50 is associated with the augmented reality content (for example, the glossy image 91), but the vehicle image 51 is not included in the imaging range 85a. Assume that part of the frame image 60A is included.
  • the information terminal 80 identifies the direction of the vehicle image 51A based on the identification information 61 included in a portion of the frame image 60A, and captures an arrow image 94 indicating the direction of the identified vehicle image 51A. may be displayed. Then, when the imaging range 85a includes the vehicle image 51A, the information terminal 80 may display a superimposed image 90 in which the glossy image 91 is superimposed on the captured image instead of the arrow image 94.
  • the user of the information terminal 80 refers to the arrow image 94 and performs an operation to change the imaging range 85a so as to include the area to the upper right of the current imaging range 85a.
  • This operation is, for example, an operation of changing the orientation of the information terminal 80, an operation of moving the information terminal 80 away from the projection target 6, an operation of zooming out the imaging module 85, or the like.
  • the vehicle image 51A is included in the imaging range 85a, and a superimposed image 90 including the vehicle image 51A and the glossy image 91 is displayed.
  • FIGS. 13 and 14 are diagrams showing an example of reproduction of augmented reality content according to attributes of the augmented reality content.
  • the projected image 70 is associated with a smoke image 92 and a meteor image 93 .
  • the smoke image 92 is an example of the first augmented reality content reproduced when the vehicle image 51A (first object) included in the projection target image 50A is included in the captured image (capturing angle of view).
  • the meteor image 93 is an example of second augmented reality content that is reproduced regardless of whether the vehicle image 51A is included in the captured image.
  • the information terminal 80 operates as follows according to the functions of the above applications. That is, the information terminal 80 stores image data representing the smoke image 92 and image data representing the meteor image 93 in advance. Attribute information indicating that the smoke image 92 is the first augmented reality content that is reproduced when the vehicle image 51A is included in the captured image is associated with the smoke image 92 . Attribute information indicating that the meteor image 93 is the second augmented reality content that is reproduced regardless of whether the vehicle image 51A is included in the captured image is associated with the meteor image 93 .
  • the imaging module 85 of the information terminal 80 captures an image including the vehicle image 51A.
  • the information terminal 80 causes the display unit 86 to display a superimposed image 90 in which the smoke image 92 and the meteor image 93 are superimposed on the captured image.
  • the imaging by the imaging module 85 of the information terminal 80 provides a captured image that does not include the vehicle image 51A.
  • the information terminal 80 causes the display unit 86 to display a superimposed image 90 in which only the meteor image 93 is superimposed on the captured image.
  • the augmented reality content associated with the projection image 70 includes the vehicle image 51A (first object) included in the projection target image 50 (first image) in the imaging angle of view.
  • First augmented reality content for example, a smoke image 92 displayed only when the vehicle image 51A is captured
  • a second augmented reality content for example, a meteor image 93 that is displayed even if the car image 51A is not shown
  • the frame image 60 may include the identification information 61 as shown in FIG.
  • the information terminal 80 for example, when the vehicle image 51A of the projection target image 50 is not included in the captured image (for example, the example of FIG. 14), or when only a part of the vehicle image 51A is included in the captured image.
  • a superimposed image 90 in which the meteor image 93 is superimposed on the captured image can be displayed.
  • the frame image 60A (second image) in the projected image 70 (third image) is an image indicating that the specific content is associated with the projected image 70.
  • the configuration of the image surrounding the projection target image 50A (first image) has been described, the configuration is not limited to this.
  • the frame image 60A (second image) in the projection image 70 (third image) indicates the position of the image of the first object associated with the augmented reality content, which is included in the projection target image 50A.
  • a configuration that is an image will be described.
  • FIG. 15 is a diagram showing an example of a frame image 60A showing the position of the image of the first object associated with the augmented reality content.
  • the frame image 60 is used as an image indicating the position of the vehicle image 51A (image of the first object).
  • the control device 4 stores object position information indicating the area (position) of the vehicle image 51 in the projection target image 50, and based on this object position information, the vehicle image 51 in the projection target image 50 is displayed as a frame image.
  • An image in which the frame image 60 is superimposed on the projection target image 50 so as to be surrounded by 60 is generated as a projection image 70 (third image).
  • the portion of the projection image 70 on which the frame image 60 is superimposed is the frame image 60A based on the second image data (the frame image 60). Also, of the projection image 70, the portion inside the frame image 60A and the portion outside the frame image 60A are the projection target image 50A based on the first image data (projection target image 50).
  • the user of the projection image 70 who is the observer of the projection image 70 can be notified of the position of the vehicle image 51A (image of the first object) associated with the glossy image 91 (augmented reality content).
  • the user of the information terminal 80 can recognize from the frame image 60A of the projection image 70 that the vehicle image 51A inside the frame image 60A is associated with the augmented reality content, and the vehicle image 51A is displayed in the imaging range 85a. , is captured by the information terminal 80 .
  • FIG. 16 shows positions of the vehicle image 51 at successive times t1 to t3.
  • the projection target image 50 is moving image content in which the vehicle image 51 moves from left to right according to the elapsed playback time.
  • the control device 4 of the projection device 10 can acquire correspondence information between the elapsed time of reproduction of the projection target image 50 (for example, time t1 to t3) and the position of the vehicle image 51 in the projection target image 50.
  • This correspondence information may be stored in the storage medium 4a of the control device 4, or may be stored in another device with which the control device 4 can communicate.
  • the control device 4 may generate a projected image 70 including a frame image 60A that moves following the movement of the vehicle image 51A, as shown in FIG.
  • the projection target image 50 may be video content in which the size of the vehicle image 51 changes according to the elapsed playback time.
  • the control device 4 can acquire correspondence information between the elapsed time of reproduction of the projection target image 50 and the size of the vehicle image 51 in the projection target image 50 . Based on this correspondence information, the control device 4 may generate the projected image 70 including the frame image 60A whose size changes in accordance with the change in size of the vehicle image 51A (not shown).
  • the projection target image 50 may be video content in which the position and size of the vehicle image 51 change according to the elapsed playback time.
  • the control device 4 can acquire correspondence information between the elapsed time of reproduction of the projection target image 50 and the position and size of the vehicle image 51 in the projection target image 50 . Based on this correspondence information, the control device 4 may generate a projection image 70 including a frame image 60A whose size changes following changes in the position and size of the vehicle image 51A (not shown).
  • FIG. 1 Specific example of frame image 60A based on display area information and position of vehicle image 51> 18 to 21 are diagrams showing specific examples of the frame image 60A based on the information on the display area and the position of the vehicle image 51.
  • the projection target 6 is a building having windows 171 and 172
  • the projection range 11 includes the windows 171 and 172.
  • the control device 4 of the projection device 10 receives input of information indicating regions corresponding to the windows 171 and 172 in the projection range 11 as information on the display region where the projection image 70 is displayed. This information is input via the operation reception unit 2, for example.
  • the projection target image 50 is moving image content in which the vehicle image 51 moves from left to right according to the elapsed playback time.
  • the control device 4 can acquire correspondence information between the elapsed time of reproduction of the projection target image 50 (for example, time t1 to t3) and the position of the vehicle image 51 in the projection target image 50 .
  • the control device 4 includes the frame image 60A in the projection image 70 as in the example shown in FIG. That is, at time t1 when the vehicle image 51A is positioned in the area corresponding to the window 171 in the projection image 70 (projection range 11), the control device 4 places the frame image 60A in the area corresponding to the window 171 in the projection image 70. include. At time t2 when the vehicle image 51A is located in the area corresponding to the window 171 and the window 172 in the projection image 70, the control device 4 places the frame image 60A in the area corresponding to the window 172 in the projection image 70. to keep the state of including . Further, at time t3 when the vehicle image 51A is positioned in the area corresponding to the window 172 in the projected image 70, the control device 4 includes the frame image 60A in the area corresponding to the window 172 in the projected image 70. FIG.
  • control device 4 may include the frame image 60A in the projection image 70 as in the example shown in FIG. That is, at time t2 when the vehicle image 51A is located in the region corresponding to the window 171 and the window 172 in the projection image 70, the control device 4 controls the region corresponding to the window 171 in the projection image 70 and the projection image
  • the frame image 60A may be included in the projection image 70 so as to include the area corresponding to the window 172 in the projection image 70 .
  • the control device 4 may include the frame image 60A in the projected image 70 so that the frame image 60A follows the outer periphery of the projected image 70, not limited to the example of FIG.
  • control device 4 may include the frame image 60A in the projection image 70 as in the example shown in FIG. That is, control device 4 does not include frame image 60A in projection image 70 at time t2 when vehicle image 51A is located in the region corresponding to window 171 and window 172 in projection image 70 (frame image 60A is not included in projection image 70). erase).
  • the control device 4 displays the frame image in the region corresponding to the window 171 in the projection image 70.
  • 60A may be included (not shown).
  • the control device 4 displays the area corresponding to the window 172 in the projection image 70 as a frame.
  • Image 60A may be included.
  • the control device 4 displays the information of the display area where the projection image 70 (third image) is displayed and the vehicle image 51 (first object image) in the projection target image 50. and the third image data representing the projection image 70 including the frame image 60A (second image) based on the position of .
  • the frame image 60A is a frame image that completely surrounds the vehicle image 51A. It may be an L-shaped one surrounding (sandwiching) the vehicle image 51A.
  • the frame image 60A has been described as the second image of the second embodiment
  • the second image of the second embodiment is not limited to the frame image, and may be an arrow image pointing to the position of the vehicle image 51A, for example.
  • (Modified example of each embodiment) ⁇ Modified example of projection device 10> 4 and 5, the configuration of the projection device 10 in which the optical axis K is not bent has been described, but a configuration in which the optical axis K is bent one or more times by providing a reflecting member in the optical unit 106 is also possible.
  • FIG. 22 is a schematic diagram showing another external configuration of the projection device 10. As shown in FIG. 23 is a schematic cross-sectional view of the optical unit 106 of the projection apparatus 10 shown in FIG. 22. FIG. In FIGS. 22 and 23, the same parts as those shown in FIGS. 4 and 5 are denoted by the same reference numerals, and description thereof is omitted.
  • the optical unit 106 includes a second member 103 supported by the first member 102 in addition to the first member 102 supported by the body portion 101 .
  • the first member 102 and the second member 103 may be an integrated member.
  • the optical unit 106 includes, in addition to the first member 102, a second member 103 having a hollow portion 3A connected to the hollow portion 2A of the first member 102, and a first member 103 arranged in the hollow portion 2A.
  • the openings 2a and 2b of the first member 102 are formed on planes perpendicular to each other.
  • the projection optical system 23 shown in FIGS. It is configured by the third optical system 33 .
  • the optical axis K is folded back by being bent twice.
  • the first optical system 121, the reflecting member 122, the second optical system 31, the reflecting member 32, the third optical system 33, and the lens 34 are arranged along the optical axis K in this order from the light modulation section 22 side.
  • the first optical system 121 guides the light that has entered the first member 102 from the main body 101 and travels in the direction X1 to the reflecting member 122 .
  • the reflecting member 122 reflects the light incident from the first optical system 121 in the direction Y1.
  • the reflecting member 122 is composed of, for example, a mirror.
  • the first member 102 has an opening 2b on the optical path of the light reflected by the reflecting member 122, and the reflected light passes through the opening 2b and advances to the hollow portion 3A of the second member 103.
  • the second member 103 is a member having a substantially L-shaped cross-sectional outline, and an opening 3a is formed at a position facing the opening 2b of the first member 102.
  • the light from the body portion 101 that has passed through the opening 2b of the first member 102 enters the hollow portion 3A of the second member 103 through this opening 3a.
  • the cross-sectional outlines of the first member 102 and the second member 103 are arbitrary, and are not limited to those described above.
  • the second optical system 31 includes at least one lens and guides light incident from the first member 102 to the reflecting member 32 .
  • the reflecting member 32 reflects the light incident from the second optical system 31 in the direction X ⁇ b>2 and guides it to the third optical system 33 .
  • the reflecting member 32 is composed of, for example, a mirror.
  • the third optical system 33 includes at least one lens and guides the light reflected by the reflecting member 32 to the lens 34 .
  • the lens 34 is arranged at the end of the second member 103 in the direction X2 so as to block the opening 3c formed at the end.
  • the lens 34 projects the light incident from the third optical system 33 onto the projection object 6 .
  • FIG. 23 shows a state in which the first member 102 has been moved to the maximum extent in the direction Y1 by the first shift mechanism 105.
  • the first member 102 is moved in the direction Y2 by the first shift mechanism 105, thereby changing the relative position between the center of the image formed by the light modulation section 22 and the optical axis K. , the image G1 projected onto the projection object 6 can be shifted in the direction Y1.
  • the projection direction changing mechanism 104 is a rotating mechanism that rotatably connects the second member 103 to the first member 102 .
  • the projection direction changing mechanism 104 allows the second member 103 to rotate about a rotation axis extending in the direction Y (specifically, the optical axis K).
  • the projection direction changing mechanism 104 is not limited to the arrangement position shown in FIG. 23 as long as it can rotate the optical system.
  • the number of rotating mechanisms is not limited to one, and a plurality of rotating mechanisms may be provided.
  • control device of the present invention is applied to the control device 4 of the projection device 10
  • the configuration is not limited to this.
  • FIG. 24 is a diagram showing a modified example of the projection system 100.
  • FIG. A projection system 100 shown in FIG. 24 includes an information terminal 110 in addition to the configuration of the projection system 100 shown in FIG.
  • the control device of the present invention may be applied to the information terminal 110.
  • the information terminal 110 is an information terminal that can directly or indirectly communicate with the projection device 10 . Communication between the information terminal 110 and the projection device 10 may be wired communication or wireless communication. The information terminal 110 executes various controls by the control device 4 by communicating with the projection device 10 . Although the information terminal 110 is a notebook personal computer in the example of FIG. 24, the information terminal 110 can be various information terminals such as a desktop personal computer, a smart phone, and a tablet terminal.
  • the first image data representing the projection target image 50 is input to the information terminal 110 .
  • the second image data representing the frame image 60 is stored in the storage medium of the information terminal 110 .
  • the information terminal 110 generates third image data representing the projection image 70 based on these image data and the like, and outputs the generated third image data to the projection device 10 (projection section).
  • the projection device 10 projects the projection image 70 based on the third image data output from the information terminal 110 .
  • FIG. 25 is a diagram showing an example of the hardware configuration of the information terminal 110.
  • the information terminal 110 shown in FIG. 1 includes a processor 111, a memory 112, a communication interface 113, and a user interface 114, as shown in FIG.
  • Processor 111 , memory 112 , communication interface 113 and user interface 114 are connected by bus 119 , for example.
  • the processor 111, memory 112, communication interface 113, and user interface 114 have the same configuration as the processor 81, memory 82, communication interface 83, and user interface 84 shown in FIG. 6, respectively.
  • the control device of the present invention may output the generated third image data to a display capable of displaying images.
  • a third image for example, an image similar to the projection image 70
  • the display may be a display of a display device including the control device of the present invention, or may be an external display capable of communicating with the control device of the present invention.
  • the augmented reality content has been described as an example of the specific content associated with the projected image 70, the specific content associated with the projected image 70 is not limited to the augmented reality content.
  • the specific content associated with the projected image 70 may be non-visual content such as sound or smell.
  • a controller comprising a processor, The above processor generating third image data based on the first image data and the second image data; outputting the third image data; Of the third images represented by the third image data, the second image based on the second image data is an image indicating that the third image is associated with specific content, and Surrounding the first image based on the first image data among the three images, Control device.
  • control device (i) (1) The control device according to The second image is in contact with at least part of the outer periphery of the first image and does not include an internal region of the first image, Control device.
  • control device the processor outputs the third image data to a projection unit; Control device.
  • control device (4) The control device according to any one of (1) to (3), The above processor generating the third image data based on information of a display area in which the third image is displayed, the first image data, and the second image data; Control device.
  • control device according to any one of (1) to (4), wherein the second image is an image determined based on the color of the first image; Control device.
  • the control device according to any one of (1) to (6),
  • the first image is an image associated with the specific content, Control device.
  • the control device according to any one of (1) to (7),
  • the second image is an image associated with the specific content, Control device.
  • the control device according to any one of (1) to (8),
  • the specific content above includes Augmented Reality content, Control device.
  • the control device includes a first augmented reality content that is reproduced when the first object included in the first image is included in the imaging angle of view, and whether or not the first object is included in the imaging angle of view. a second augmented reality content that is played regardless of Control device.
  • the control device according to any one of (1) to (10), the second image includes an identification image;
  • the identification image is information that can specify the relative position of the identification image in the third image, Control device.
  • a controller comprising a processor, The processor generating third image data based on the first image data and the second image data; outputting the third image data; The second image based on the second image data among the third images represented by the third image data has specific content included in the first image based on the first image data among the third images.
  • the control device according to the image of the first object is a moving image in the third image;
  • the second image is an image that moves following the movement of the image of the first object. Control device.
  • control device (14) The control device according to (12) or (13), The above processor the third image including the second image based on correspondence information between the elapsed time of reproduction of the first image and at least one of the position and size of the image of the first object in the first image; generating the third image data representing Control device.
  • control device according to any one of (12) to (14), The above processor The third image representing the third image including the second image based on the information of the characteristic area of the display area in which the third image is displayed and the position of the image of the first object in the third image. generate image data, Control device.
  • control device according to any one of (12) to (15), wherein the second image is a frame image surrounding at least part of the image of the first object; Control device.
  • the controller processor generating third image data based on the first image data and the second image data; outputting the third image data;
  • the second image based on the second image data is an image indicating that the third image is associated with specific content, and Surrounding the first image based on the first image data among the three images, control method.
  • the controller processor generating third image data based on the first image data and the second image data; outputting the third image data;
  • the second image based on the second image data among the third images represented by the third image data has specific content included in the first image based on the first image data among the third images.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
PCT/JP2022/040695 2021-11-30 2022-10-31 制御装置、制御方法、及び制御プログラム Ceased WO2023100573A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2023564818A JPWO2023100573A1 (https=) 2021-11-30 2022-10-31
US18/676,895 US20240312164A1 (en) 2021-11-30 2024-05-29 Control device, control method, and control program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021194119 2021-11-30
JP2021-194119 2021-11-30

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/676,895 Continuation US20240312164A1 (en) 2021-11-30 2024-05-29 Control device, control method, and control program

Publications (1)

Publication Number Publication Date
WO2023100573A1 true WO2023100573A1 (ja) 2023-06-08

Family

ID=86611884

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/040695 Ceased WO2023100573A1 (ja) 2021-11-30 2022-10-31 制御装置、制御方法、及び制御プログラム

Country Status (3)

Country Link
US (1) US20240312164A1 (https=)
JP (1) JPWO2023100573A1 (https=)
WO (1) WO2023100573A1 (https=)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007192988A (ja) * 2006-01-18 2007-08-02 Asv:Kk 映像再生システムにおけるオブジェクト強調表示方式およびオブジェクト軌跡オーバレイ表示方式ならびにこれら表示方式に用いられるプレイヤ装置およびサーバ装置
JP2012212345A (ja) * 2011-03-31 2012-11-01 Sony Corp 端末装置、オブジェクト制御方法及びプログラム
JP2013175942A (ja) * 2012-02-24 2013-09-05 Sharp Corp 表示装置、表示装置の制御方法、制御プログラム、および記録媒体

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5642027B2 (ja) * 2011-07-06 2014-12-17 株式会社日立パワーソリューションズ 異音診断装置および異音診断方法
JP5765590B2 (ja) * 2013-03-15 2015-08-19 カシオ計算機株式会社 撮像装置、表示方法及びプログラム
JP6493860B2 (ja) * 2015-07-23 2019-04-03 パナソニックＩｐマネジメント株式会社 監視制御システム及び監視制御方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007192988A (ja) * 2006-01-18 2007-08-02 Asv:Kk 映像再生システムにおけるオブジェクト強調表示方式およびオブジェクト軌跡オーバレイ表示方式ならびにこれら表示方式に用いられるプレイヤ装置およびサーバ装置
JP2012212345A (ja) * 2011-03-31 2012-11-01 Sony Corp 端末装置、オブジェクト制御方法及びプログラム
JP2013175942A (ja) * 2012-02-24 2013-09-05 Sharp Corp 表示装置、表示装置の制御方法、制御プログラム、および記録媒体

Also Published As

Publication number Publication date
JPWO2023100573A1 (https=) 2023-06-08
US20240312164A1 (en) 2024-09-19

Similar Documents

Publication Publication Date Title
JP6780315B2 (ja) 投影装置、投影システム、投影方法及びプログラム
CN115113216A (zh) 检测装置、检测方法以及空间投影装置
CN115112042A (zh) 检测装置、检测方法以及空间投影装置
CN104978079B (zh) 双向显示方法以及双向显示装置
WO2018051886A1 (ja) 検出機能付き表示装置
WO2023100573A1 (ja) 制御装置、制御方法、及び制御プログラム
TWI639339B (zh) 投影單元及應用其的投影裝置
US20240348741A1 (en) Control device, control method, and control program
JP7649715B2 (ja) 制御装置、制御方法、投影システム、及び制御プログラム
US10788742B2 (en) Display system
US12267634B2 (en) Projection apparatus, projection method, control device, and control program
WO2021131646A1 (ja) 投影装置、投影方法、及び制御プログラム
US12556665B2 (en) Control device, control method, control program, and system
JP7347205B2 (ja) 投写システムの制御方法、投写システム及び制御プログラム
CN115136071B (zh) 投影装置、投影方法及存储介质
JP2014233005A (ja) 画像表示装置
US20240422299A1 (en) Control device, control method, and control program
JP7427804B2 (ja) 制御装置、制御方法、制御プログラム、及び投影システム
JP7336027B2 (ja) 制御方法、投影装置、及び制御プログラム
JP7709444B2 (ja) 制御装置、制御方法、制御プログラム、及び投影システム
JP2021068145A (ja) 頭部装着型表示装置の動作方法および頭部装着型表示装置
JP7757735B2 (ja) プロジェクションシステム、及び、プロジェクションシステムの制御方法
JP2007017516A (ja) ２次元の位置情報を投影する機能を備えたプロジェクタ
WO2024224924A1 (ja) 投影装置、制御方法、及び制御プログラム
WO2025047471A1 (ja) 情報処理装置、情報処理方法、及び情報処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22901006

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2023564818

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22901006

Country of ref document: EP

Kind code of ref document: A1