WO2023042401A1 - 画像提示装置、画像提示方法、及びプログラム - Google Patents

画像提示装置、画像提示方法、及びプログラム Download PDF

Info

Publication number
WO2023042401A1
WO2023042401A1 PCT/JP2021/034432 JP2021034432W WO2023042401A1 WO 2023042401 A1 WO2023042401 A1 WO 2023042401A1 JP 2021034432 W JP2021034432 W JP 2021034432W WO 2023042401 A1 WO2023042401 A1 WO 2023042401A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
effect
user
presentation device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/034432
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
秀明 岩本
裕 千明
督史 鈴木
龍也 松井
聡 佐久間
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Inc
Original Assignee
Nippon Telegraph and Telephone Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Telegraph and Telephone Corp filed Critical Nippon Telegraph and Telephone Corp
Priority to US18/691,834 priority Critical patent/US20250133284A1/en
Priority to JP2023548083A priority patent/JPWO2023042401A1/ja
Priority to PCT/JP2021/034432 priority patent/WO2023042401A1/ja
Publication of WO2023042401A1 publication Critical patent/WO2023042401A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/64Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the present disclosure relates to an image presentation device, an image presentation method, and a program.
  • FIG. 10 is a block diagram showing a configuration example of a conventional image presentation device.
  • the image capturing unit 11 creates a captured image a by capturing an image of the user
  • the image processing unit 12 creates a processed image b by processing the captured image a with an effect.
  • the image combining unit 14 creates a combined image d by combining the processed images b of a plurality of users, and presents the combined image d on the display device (display) 4 .
  • Effect means to process sound or image and add some kind of special effect.
  • Non-Patent Document 1 discloses a commemorative photography service provided at attractions such as theme parks and amusement parks. A service that combines and presents images of users of
  • Non-Patent Document 2 describes a service for processing an image of a user using Kabuki kumadori. In addition to this, a service may be considered in which images of a plurality of surrounding users are combined and presented on a display device such as a large monitor.
  • Fujifilm ⁇ The world only Fuji knows - Make the best memories of the theme park'', [online], [Searched August 26, 2021], Internet ⁇ URL: https://sp-jp.fujifilm.com /netprint/shiranai-sekai/sep_2017/> NTT realizes the fusion of Kabuki and the latest ICT technology at Niconico Chokaigi 2016 and Japan KABUKI Festival in Las Vegas 2016, [searched August 26, 2021], Internet ⁇ URL: https://group.ntt /jp/newsrelease/2017/04/19/160419a.html>
  • the images that the user accesses include images of users other than himself/herself, there is a problem that it is a burden to find the image taken by the user himself/herself.
  • An object of the present invention which has been made in view of such circumstances, is to alternately present an image processed with an effect and an image before processing when providing an image to the user, so that the user can: To reduce the burden of finding an image in which oneself is photographed from among a plurality of images.
  • an image presentation device for presenting an image of a user, comprising: an image photographing unit for photographing images of a plurality of users; An image processing unit that processes an image using an effect, and an image combining unit that alternately switches between the photographed image and the processed image and displays the image on a display device.
  • an image presentation method for presenting an image of a user, comprising the steps of photographing images of a plurality of users with an image presentation device; The step of processing the photographed image using an effect, and the step of alternately switching between the photographed images of the plurality of users and the processed images and displaying them on a display device are included.
  • the computer according to the first embodiment is caused to function as the above image presentation device.
  • the user can easily find the image in which he or she was shot from among the multiple images.
  • FIG. 1 is a block diagram showing a configuration example of an image presentation device according to a first embodiment
  • FIG. It is an illustration of an image (photographed image) of a user. It is an illustration of an image (processed image) obtained by processing a photographed image using an effect.
  • FIG. 4 is a schematic diagram showing an image (composite image) obtained by compositing a photographed image and a processed image; It is a schematic diagram showing an image (combined image) obtained by combining composite images of a plurality of users.
  • 4 is a flow chart showing an example of an image presentation method executed by the image presentation device according to the first embodiment; It is a block diagram which shows the structural example of the image presentation apparatus which concerns on 2nd Embodiment.
  • FIG. 9 is a flow chart showing an example of an image presentation method executed by the image presentation device according to the second embodiment.
  • 1 is a block diagram showing a schematic configuration of a computer functioning as an image presentation device;
  • FIG. It is a block diagram which shows the structural example of the conventional image presentation apparatus.
  • FIG. 1 is a block diagram showing a configuration example of an image presentation device according to the first embodiment.
  • the image presentation device 1 shown in FIG. 1 includes an image capturing section 11, an image processing section 12, an image synthesizing section 13, and an image combining section .
  • the image presentation device 1 presents a user's image by alternately switching between an image processed by an effect and an image before processing.
  • the image processing unit 12, the image synthesizing unit 13, and the image combining unit 14 constitute a control arithmetic circuit (controller).
  • the control arithmetic circuit may be configured by dedicated hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array), may be configured by a processor, or may be configured by including both may be
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the image capturing unit 11 captures an image of the user.
  • the image capturing unit 11 is a camera.
  • FIG. 2 is an illustration of a photographed image of a user (hereinafter referred to as "photographed image a", “photographed image a", or "a”).
  • the image capturing unit 11 outputs the captured image a to the image processing unit 12 and the image synthesizing unit 13 .
  • the image processing unit 12 processes the captured image a using effects.
  • the image processing unit 12 may use effects that the image presentation device 1 has in advance. If the image presentation device 1 does not have an effect, an effect image input from an external terminal or an effect indicated by an effect image specified by the user may be used.
  • FIG. 3 is an illustration of an image obtained by processing the captured image a using effects (hereinafter referred to as “processed image b”, “processed image b” or “b”).
  • the sunglasses s correspond to the effect image showing the effect, and an example is shown in which the effect image is superimposed on the captured image a as "processing".
  • the image processing unit 12 outputs the processed image b to the image synthesizing unit 13 .
  • the image synthesizing unit 13 synthesizes the captured image a input from the image capturing unit 11 and the processed image b input from the image processing unit 12 .
  • FIG. 4 is a schematic diagram showing a synthesized image obtained by synthesizing a photographed image and a processed image (hereinafter referred to as "synthesized image c", “synthesized image c", or "c").
  • the synthesized image c is composed of the captured image a and the processed image b.
  • the image synthesizing unit 13 may generate a synthesized image c that is presented by alternately switching between the captured image a and the processed image b of the user. For example, the captured image a and the processed image b of the user may be alternately switched at intervals of several seconds and presented.
  • the image synthesizing unit 13 sequentially outputs the synthetic image c of each user to the image combining unit 14 .
  • the image combining unit 14 generates an image d by combining the combined images c for a plurality of users sequentially received from the image combining unit 13 .
  • FIG. 5 is a schematic diagram showing an image obtained by combining composite images c of a plurality of users (hereinafter referred to as "combined image d", “combined image d", or "d").
  • the image combining unit 14 generates a combined image d in which captured images a and processed images b of a plurality of users are alternately switched and presented for each user.
  • the captured image a and the processed image b of a plurality of users may be alternately switched at intervals of several seconds and presented for each user.
  • the image combiner 14 causes the display device 4 to alternately display the photographed images a and the processed images b of a plurality of users for each user.
  • the photographed image a of the faces of a plurality of users and the image of the shading faces superimposed on the faces of the plurality of users may be alternately switched for each user and displayed on a large monitor.
  • the kumadori corresponds to an effect image that adds an effect (special effect) to the user's face
  • each image of the kumadori face corresponds to the processed image b indicating the effect (special effect).
  • An image obtained by alternately switching between the photographed images a of a plurality of users and the processed images b of the shading faces and displaying them corresponds to the combined image d.
  • the large monitor corresponds to the display device 4 .
  • FIG. 6 is a flowchart showing an example of an image presentation method executed by the image presentation device according to the first embodiment.
  • step S101 the image photographing unit 11 photographs the user and creates a photographed image a.
  • step S102 the image processing unit 12 processes the captured image a using effects.
  • step S103 the image synthesizing unit 13 synthesizes the captured image a and the processed image b obtained by processing the captured image a using an effect.
  • step S104 the image combining unit 14 combines the composite images c of multiple users.
  • step S105 the image combining unit 14 causes the display device 4 to alternately switch between the photographed image a and the processed image b, which constitute the composite image c of a plurality of users, and display them.
  • the image processed by the effect and the image before processing are alternately displayed, so that the user can find out the image in which he or she is photographed from among the plurality of images. becomes easier.
  • FIG. 7 is a block diagram showing a configuration example of an image presentation device according to the second embodiment.
  • the image presentation device 2 shown in FIG. 7 includes an image capturing section 11 , an image processing section 12 , an image synthesizing section 13 , an image combining section 14 and an effect selecting section 15 .
  • the image presentation device 2 is different from the image presentation device 1 according to the first embodiment in that it further includes an effect selection unit 15 .
  • the image processing unit 12, the image synthesizing unit 13, the image combining unit 14, and the effect selecting unit 15 constitute a control arithmetic circuit (controller).
  • the control arithmetic circuit may be configured by dedicated hardware such as ASIC (Application Specific Integrated Circuit) or FPGA (Field-Programmable Gate Array), may be configured by a processor, or may be configured by including both may be
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the effect selection unit 15 allows the user to select an effect to be used for processing the image before capturing the user's image.
  • the effect selection unit 15 may be connected to an input terminal such as a keyboard or touch panel that supports input operations. In such a case, the user selects an effect using the input terminal.
  • the effect selection section 15 outputs the effect selected by the user to the image processing section 12 .
  • the image processing unit 12 processes the captured image a of the user using the effect selected by the user.
  • the effect selection unit 15 may generate a plurality of effect images showing effects (special effects) and output the effects shown by the effect images selected by the user to the image processing unit 12 .
  • the effect selection unit 15 may be connected to a display that supports pen input operations. In such a case, the user draws an effect image showing the effect on the display corresponding to the pen input.
  • the effect selection unit 15 may be connected to a camera corresponding to the image capturing operation. In such a case, the user causes the camera to capture an effect image showing the effect.
  • the effect selector 15 may be connected to a wireless or wired signal receiver.
  • the user transmits an effect image edited using image editing software on a terminal device such as a smartphone, tablet, or PC, from the terminal device to the signal receiver wirelessly or by wire.
  • the effect selection unit 15 may receive a plurality of effect images from at least one of the input terminals such as the display, camera, and signal receiver.
  • the effect selection unit 15 outputs to the image processing unit 12 the effect indicated by the effect image selected by the user among the effects indicated by the plurality of received effect images.
  • the image processing unit 12 processes the user's captured image a using the effect selected by the user input from the effect selection unit 15 .
  • FIG. 8 is a flowchart showing an example of an image display method executed by the image presentation device according to the second embodiment.
  • step S201 the effect selection unit 15 causes the user to select an effect to be used for processing the captured image a before capturing the user in advance.
  • step S202 the image photographing unit 11 photographs the user and creates a photographed image a.
  • step S203 the image processing unit 12 processes the captured image a using the effect selected by the user.
  • step S204 the image synthesizing unit 13 synthesizes the captured image a and the processed image b obtained by processing the captured image a.
  • step S205 the image combining unit 14 combines the composite images c of multiple users.
  • step S206 the image combining unit 14 causes the display device 4 to alternately switch between the photographed image a and the processed image b that constitute the composite image c of a plurality of users.
  • the image presentation device 2 the image b processed by the effect selected in advance by the user and the image a before processing are alternately displayed. Alternatively, it becomes easy to find an image in which the user is photographed based on the photographed image a of the user before processing.
  • FIG. 9 is a block diagram showing a schematic configuration of a computer that functions as an image presentation device.
  • the computer functioning as the image presentation device 1 and the image presentation device 2 may be a general-purpose computer, a dedicated computer, a workstation, a PC (Personal Computer), an electronic notepad, or the like.
  • Program instructions may be program code, code segments, etc. for performing the required tasks.
  • the computer 100 includes a processor 110, a ROM (Read Only Memory) 120, a RAM (Random Access Memory) 130, and a storage 140 as storage units, an input unit 150, an output unit 160, and communication and an interface (I/F) 170 .
  • a processor 110 a ROM (Read Only Memory) 120, a RAM (Random Access Memory) 130, and a storage 140 as storage units, an input unit 150, an output unit 160, and communication and an interface (I/F) 170 .
  • ROM Read Only Memory
  • RAM Random Access Memory
  • storage 140 storage units
  • I/F interface
  • the ROM 120 stores various programs and various data.
  • RAM 130 temporarily stores programs or data as a work area.
  • the storage 140 is configured by a HDD (Hard Disk Drive) or SSD (Solid State Drive) and stores various programs including an operating system and various data.
  • the ROM 120 or the storage 140 stores programs according to the present disclosure.
  • the processor 110 is specifically a CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), DSP (Digital Signal Processor), SoC (System on a Chip), or the like. may be configured by a plurality of processors of The processor 110 reads a program from the ROM 120 or the storage 140 and executes the program using the RAM 130 as a work area, thereby performing control of each configuration and various arithmetic processing. Note that at least part of these processing contents may be realized by hardware.
  • CPU Central Processing Unit
  • MPU Micro Processing Unit
  • GPU Graphics Processing Unit
  • DSP Digital Signal Processor
  • SoC System on a Chip
  • the program may be recorded in a recording medium readable by the image presentation device 1 and the image presentation device 2.
  • a recording medium By using such a recording medium, it is possible to install in the image presentation device 1 and the image presentation device 2 .
  • the recording medium on which the program is recorded may be a non-transitory recording medium.
  • the non-transitory recording medium is not particularly limited, but may be, for example, a CD-ROM, a DVD-ROM, a USB (Universal Serial Bus) memory, or the like.
  • this program may be downloaded from an external device via a network.
  • An image presentation device for presenting an image of a user, a camera that captures images of multiple users; a controller that processes the photographed image using an effect, alternately switches between the photographed image of the plurality of users and the processed image, and displays the photographed image on a display;
  • An image presentation device comprising: (Appendix 2) The controller is The image presentation according to claim 1, wherein a combined image is generated by alternately switching between the captured image and the processed image of the user, and the combined images are combined for the plurality of users.
  • the controller is 3.
  • the image presentation device according to claim 1 or 2 wherein the user is allowed to select the effect used for processing the image.
  • the controller is 4.
  • the image presentation device which generates a plurality of effect images showing effects.
  • Appendix 5 An image presentation method for presenting an image of a user, With the image presentation device, a step of photographing images of a plurality of users; a step of processing the photographed images using the effects; and alternately switching between the photographed images and the processed images of the plurality of users and displaying them on a display. and a step of displaying.
  • Appendix 6 A non-temporary storage medium storing a program executable by a computer, the non-temporary storage medium storing a program for causing the computer to function as the image presentation device according to any one of additional items 1 to 4.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)
PCT/JP2021/034432 2021-09-17 2021-09-17 画像提示装置、画像提示方法、及びプログラム Ceased WO2023042401A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US18/691,834 US20250133284A1 (en) 2021-09-17 2021-09-17 Image presentation device, image presentation method, and program
JP2023548083A JPWO2023042401A1 (https=) 2021-09-17 2021-09-17
PCT/JP2021/034432 WO2023042401A1 (ja) 2021-09-17 2021-09-17 画像提示装置、画像提示方法、及びプログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/034432 WO2023042401A1 (ja) 2021-09-17 2021-09-17 画像提示装置、画像提示方法、及びプログラム

Publications (1)

Publication Number Publication Date
WO2023042401A1 true WO2023042401A1 (ja) 2023-03-23

Family

ID=85602648

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/034432 Ceased WO2023042401A1 (ja) 2021-09-17 2021-09-17 画像提示装置、画像提示方法、及びプログラム

Country Status (3)

Country Link
US (1) US20250133284A1 (https=)
JP (1) JPWO2023042401A1 (https=)
WO (1) WO2023042401A1 (https=)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018510A (ja) * 2001-06-28 2003-01-17 Konica Corp 画像処理システム、画像処理方法、撮像補助装置及び撮像装置
JP2003157326A (ja) * 2001-11-22 2003-05-30 Hotpot:Kk インターネットを用いた写真等の画像の付加価値化システム
JP2004048275A (ja) * 2002-07-10 2004-02-12 Omron Corp 写真シール自動販売機および方法、印刷媒体、並びに印刷媒体ユニット
JP2007184683A (ja) * 2006-01-04 2007-07-19 Eastman Kodak Co 画像データ処理装置及び方法
JP2008052569A (ja) * 2006-08-25 2008-03-06 Furyu Kk 写真シール作成装置および方法、並びにプログラム
JP2010068129A (ja) * 2008-09-09 2010-03-25 Casio Comput Co Ltd 撮影装置及びプログラム
JP2018195881A (ja) * 2017-05-12 2018-12-06 フリュー株式会社 写真シール作成装置、写真シール作成方法及び写真シール作成処理プログラム

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6621524B1 (en) * 1997-01-10 2003-09-16 Casio Computer Co., Ltd. Image pickup apparatus and method for processing images obtained by means of same
JP3843201B2 (ja) * 2000-04-06 2006-11-08 株式会社エヌ・ティ・ティ・ドコモ 場景監視システム
JP4676110B2 (ja) * 2001-09-19 2011-04-27 ヤフー株式会社 広告画像を含む画面データを配信するシステム及び方法、そのようなシステムから送信された画面データを表示させるためのプログラム、このプログラムを記録した記録媒体
JP3946676B2 (ja) * 2003-08-28 2007-07-18 株式会社東芝 撮影画像処理装置及びその方法
JP5371501B2 (ja) * 2009-03-17 2013-12-18 オリンパスイメージング株式会社 画像処理装置、画像処理方法、および、画像処理プログラム
JP5806512B2 (ja) * 2011-05-31 2015-11-10 オリンパス株式会社 撮像装置、撮像方法および撮像プログラム
WO2019203313A1 (ja) * 2018-04-18 2019-10-24 株式会社ニコン 画像処理方法、プログラム、及び画像処理装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018510A (ja) * 2001-06-28 2003-01-17 Konica Corp 画像処理システム、画像処理方法、撮像補助装置及び撮像装置
JP2003157326A (ja) * 2001-11-22 2003-05-30 Hotpot:Kk インターネットを用いた写真等の画像の付加価値化システム
JP2004048275A (ja) * 2002-07-10 2004-02-12 Omron Corp 写真シール自動販売機および方法、印刷媒体、並びに印刷媒体ユニット
JP2007184683A (ja) * 2006-01-04 2007-07-19 Eastman Kodak Co 画像データ処理装置及び方法
JP2008052569A (ja) * 2006-08-25 2008-03-06 Furyu Kk 写真シール作成装置および方法、並びにプログラム
JP2010068129A (ja) * 2008-09-09 2010-03-25 Casio Comput Co Ltd 撮影装置及びプログラム
JP2018195881A (ja) * 2017-05-12 2018-12-06 フリュー株式会社 写真シール作成装置、写真シール作成方法及び写真シール作成処理プログラム

Also Published As

Publication number Publication date
US20250133284A1 (en) 2025-04-24
JPWO2023042401A1 (https=) 2023-03-23

Similar Documents

Publication Publication Date Title
JP7589374B2 (ja) 情報処理装置、情報処理方法およびコンピュータプログラム
JP6055433B2 (ja) ゲーム提供サーバ
US9509907B2 (en) Information processing device, storage medium having moving image data stored thereon, information processing system, storage medium having moving image reproduction program stored thereon, and moving image reproduction method
US20140016913A1 (en) Moving image generation device
JP2019139673A (ja) 情報処理装置、情報処理方法およびコンピュータプログラム
CN115033195B (zh) 画面显示方法、装置、设备、存储介质及程序产品
JP2018116537A (ja) 情報処理装置、情報処理方法及びプログラム
JP6812181B2 (ja) 画像処理装置、画像処理方法、及び、プログラム
EP3070681A1 (en) Display control device, display control method and program
US8675014B1 (en) Efficiently detecting graphics objects near a selected point
JP2022188776A (ja) アバター出力装置、端末装置、アバター出力方法、およびプログラム
JP2017225509A (ja) 映像生成システムおよび映像生成プログラム
CN111652986B (zh) 舞台效果呈现方法、装置、电子设备及存储介质
JP5686611B2 (ja) 情報処理装置
CN114445600A (zh) 一种特效道具的展示方法、装置、设备及存储介质
CN111221444A (zh) 分屏特效处理方法、装置、电子设备和存储介质
CN112804578A (zh) 氛围特效生成方法、装置、电子设备和存储介质
JP2018041201A (ja) 表示制御プログラム、表示制御方法および情報処理装置
WO2023042401A1 (ja) 画像提示装置、画像提示方法、及びプログラム
TW201234837A (en) 3D format conversion systems and methods
US12356107B2 (en) Image special effect processing method and apparatus, and electronic device and computer readable storage medium
JP2005100115A (ja) ゲームプログラム、及びゲーム装置
JP2022188335A (ja) アバター出力装置、端末装置、アバター出力方法、およびプログラム
JP4142427B2 (ja) 画像合成装置
JP7832165B2 (ja) 画像処理装置、画像処理方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21957582

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023548083

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 18691834

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21957582

Country of ref document: EP

Kind code of ref document: A1

WWP Wipo information: published in national office

Ref document number: 18691834

Country of ref document: US