EP2529813A3 - Image processing apparatus and image processing method for displaying video image capable of achieving improved operability and realism, and program for controlling image processing apparatus - Google Patents

Image processing apparatus and image processing method for displaying video image capable of achieving improved operability and realism, and program for controlling image processing apparatus Download PDF

Info

Publication number
EP2529813A3
EP2529813A3 EP12170495.1A EP12170495A EP2529813A3 EP 2529813 A3 EP2529813 A3 EP 2529813A3 EP 12170495 A EP12170495 A EP 12170495A EP 2529813 A3 EP2529813 A3 EP 2529813A3
Authority
EP
European Patent Office
Prior art keywords
image processing
processing apparatus
virtual camera
realism
program
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP12170495.1A
Other languages
German (de)
French (fr)
Other versions
EP2529813B1 (en
EP2529813A2 (en
Inventor
Hiromasa Shikata
Shinji Okane
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nintendo Co Ltd
Original Assignee
Nintendo Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=46419884&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=EP2529813(A3) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Nintendo Co Ltd filed Critical Nintendo Co Ltd
Publication of EP2529813A2 publication Critical patent/EP2529813A2/en
Publication of EP2529813A3 publication Critical patent/EP2529813A3/en
Application granted granted Critical
Publication of EP2529813B1 publication Critical patent/EP2529813B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525—Changing parameters of virtual cameras
    • A63F13/5258—Changing parameters of virtual cameras by dynamically adapting the position of the virtual camera to keep a game object or game character in its viewing frustum, e.g. for tracking a character or a ball
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
    • A63F2300/6661—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera
    • A63F2300/6676—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera by dedicated player input
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
    • A63F2300/6661—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera
    • A63F2300/6684—Methods for processing data by generating or executing the game program for rendering three dimensional images for changing the position of the virtual camera by dynamically adapting its position to keep a game object in its viewing frustrum, e.g. for tracking a character or a ball

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An exemplary embodiment provides an image processing apparatus (10). The image processing apparatus includes a first object control unit (210) for changing an orientation or a direction of movement of a first object in a three-dimensional space, a virtual camera control unit (220) for determining a direction of shooting of the virtual camera in the three-dimensional space, and a display data generation unit (230) for generating display data based on the determined direction of shooting of the virtual camera. The virtual camera control unit includes a detection unit (222) for detecting whether the first object is hidden by another object when viewed from the virtual camera and a first following change unit (224) for increasing a degree of causing the direction of shooting of the virtual camera to follow the orientation or the direction of movement of the first object based on a result of detection.
EP12170495.1A 2011-06-02 2012-06-01 Image processing apparatus and image processing method for displaying video image capable of achieving improved operability and realism, and program for controlling image processing apparatus Active EP2529813B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2011124265A JP6085411B2 (en) 2011-06-02 2011-06-02 Image processing apparatus, image processing method, and control program for image processing apparatus

Publications (3)

Publication Number Publication Date
EP2529813A2 EP2529813A2 (en) 2012-12-05
EP2529813A3 true EP2529813A3 (en) 2013-10-30
EP2529813B1 EP2529813B1 (en) 2014-07-16

Family

ID=46419884

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12170495.1A Active EP2529813B1 (en) 2011-06-02 2012-06-01 Image processing apparatus and image processing method for displaying video image capable of achieving improved operability and realism, and program for controlling image processing apparatus

Country Status (3)

Country Link
US (1) US10653959B2 (en)
EP (1) EP2529813B1 (en)
JP (1) JP6085411B2 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014235596A (en) * 2013-06-03 2014-12-15 任天堂株式会社 Information processing program, information processing system, information processing device, and information processing method
US9332285B1 (en) * 2014-05-28 2016-05-03 Lucasfilm Entertainment Company Ltd. Switching modes of a media content item
JP6689694B2 (en) * 2016-07-13 2020-04-28 株式会社バンダイナムコエンターテインメント Simulation system and program
US10376794B2 (en) * 2016-08-26 2019-08-13 Minkonet Corporation Method of providing observing service using event prediction in game
US10824888B1 (en) * 2017-01-19 2020-11-03 State Farm Mutual Automobile Insurance Company Imaging analysis technology to assess movements of vehicle occupants
JP6930234B2 (en) * 2017-06-07 2021-09-01 株式会社豊田中央研究所 Collision sensation presentation system and program
CN109634413B (en) * 2018-12-05 2021-06-11 腾讯科技（深圳）有限公司 Method, device and storage medium for observing virtual environment
JP7476580B2 (en) 2020-03-09 2024-05-01 株式会社Ｊｖｃケンウッド Spectating support device, spectacle support method, and spectacle support program
CN112153242A (en) * 2020-08-27 2020-12-29 北京电影学院 Virtual photography method based on camera behavior learning and sample driving

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1125609A2 (en) * 2000-01-21 2001-08-22 Sony Computer Entertainment Inc. Entertainment apparatus, storage medium and object display method
EP1312400A2 (en) * 2001-11-15 2003-05-21 Square Co., Ltd. Character display method in three-dimensional video game

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3141737B2 (en) * 1995-08-10 2001-03-05 株式会社セガ Virtual image generation apparatus and method
JP3544268B2 (en) 1995-10-09 2004-07-21 任天堂株式会社 Three-dimensional image processing apparatus and image processing method using the same
JP3882287B2 (en) * 1997-03-07 2007-02-14 株式会社セガ Fishing equipment
JP3145059B2 (en) * 1997-06-13 2001-03-12 株式会社ナムコ Information storage medium and image generation device
WO1999027498A1 (en) 1997-11-25 1999-06-03 Sega Enterprises, Ltd. Image generating device
JP2000288248A (en) * 1999-04-05 2000-10-17 Namco Ltd Game device and information storage medium
JP3583994B2 (en) * 2000-01-21 2004-11-04 株式会社ソニー・コンピュータエンタテインメント Entertainment device, storage medium, and object display method
JP2001269482A (en) * 2000-03-24 2001-10-02 Konami Computer Entertainment Japan Inc Game system, computer-readable recording medium in which program for game is stored and image displaying method
JP4145512B2 (en) * 2001-08-09 2008-09-03 株式会社コナミデジタルエンタテインメント Image processing system and program thereof
JP3523228B2 (en) * 2001-11-07 2004-04-26 株式会社スクウェア・エニックス VIDEO GAME DEVICE, CHARACTER DISPLAY METHOD, PROGRAM, AND RECORDING MEDIUM FOR VIDEO GAME
JP3637031B2 (en) 2002-04-03 2005-04-06 任天堂株式会社 GAME DEVICE AND GAME PROGRAM
JP4213011B2 (en) * 2003-03-10 2009-01-21 任天堂株式会社 GAME DEVICE AND GAME PROGRAM
US6972696B2 (en) * 2003-03-22 2005-12-06 Rogers Steven P Aircraft future position and flight path indicator symbology
JP2004329463A (en) * 2003-05-06 2004-11-25 Nintendo Co Ltd Game device and control program of virtual camera
JP4247218B2 (en) * 2005-08-26 2009-04-02 株式会社コナミデジタルエンタテインメント GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM
US7840031B2 (en) * 2007-01-12 2010-11-23 International Business Machines Corporation Tracking a range of body movement based on 3D captured image streams of a user
JP5042651B2 (en) * 2007-01-31 2012-10-03 株式会社バンダイナムコゲームス PROGRAM, INFORMATION STORAGE MEDIUM, AND GAME DEVICE
JP4489800B2 (en) * 2007-08-30 2010-06-23 株式会社スクウェア・エニックス Image generating apparatus and method, program, and recording medium
JP5390093B2 (en) * 2007-12-21 2014-01-15 任天堂株式会社 GAME PROGRAM AND GAME DEVICE
JP5199053B2 (en) * 2008-12-16 2013-05-15 株式会社スクウェア・エニックス GAME DEVICE, GAME REPLAY DISPLAY METHOD, GAME PROGRAM, AND RECORDING MEDIUM
US8576235B1 (en) * 2009-07-13 2013-11-05 Disney Enterprises, Inc. Visibility transition planning for dynamic camera control
JP5148652B2 (en) * 2010-03-31 2013-02-20 株式会社バンダイナムコゲームス Program, information storage medium, and image generation system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1125609A2 (en) * 2000-01-21 2001-08-22 Sony Computer Entertainment Inc. Entertainment apparatus, storage medium and object display method
EP1312400A2 (en) * 2001-11-15 2003-05-21 Square Co., Ltd. Character display method in three-dimensional video game

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
HUGH MCCABE ET AL: "A Virtual Cinematography System for First Person Shooter Games", PROC. OF DIG2006, INTERNATIONAL DIGITAL GAMES CONFERENCE, 27 September 2006 (2006-09-27), Portalegre, Portugal, pages 25 - 35, XP055080131, ISBN: 978-9-89-951860-5, Retrieved from the Internet <URL:http://gamesitb.com/idig2006paper.pdf> [retrieved on 20130919] *
MARC CHRISTIE AND PATRICK OLIVIER: "Camera Control in Computer Graphics", EUROGRAPHICS, SPRINGER VERLAG, VIENNA, AT, vol. 25, no. 3, 1 January 2006 (2006-01-01), pages 1 - 25, XP007905927, ISSN: 0946-2767 *

Also Published As

Publication number Publication date
JP2012249799A (en) 2012-12-20
EP2529813B1 (en) 2014-07-16
US10653959B2 (en) 2020-05-19
US20120307011A1 (en) 2012-12-06
JP6085411B2 (en) 2017-02-22
EP2529813A2 (en) 2012-12-05

Similar Documents

Publication Publication Date Title
EP2529813A3 (en) Image processing apparatus and image processing method for displaying video image capable of achieving improved operability and realism, and program for controlling image processing apparatus
EP2506222A3 (en) Augmented reality apparatus, method and program
EP2497548A3 (en) Information processing program, information processing apparatus, information processing system, and information processing method
JP2013105253A5 (en)
EP2228109A3 (en) Information processing apparatus, storage medium having information processing program stored therein, information processing system, and display range control method
JP2017054201A5 (en)
EP2365427A3 (en) Computer-readable storage medium having stored therein display control program, display control apparatus, display control system, and display control method
EP2394718A3 (en) Image generation system, image generation method, and information storage medium for video games
JP2012208719A5 (en)
EP2418862A3 (en) System, apparatus, and method for displaying 3-dimensional image and location tracking device
EP2466440A3 (en) Display control program, display control apparatus, display control system, and display control method
EP2529810A3 (en) Information processing system, information processing device, information processing program, and moving image reproduction control method
MY173983A (en) Information providing apparatus, information providing method and program
EP1726342A3 (en) Image processing program and image processing device for moving display area
EP2497545A3 (en) Information processing program, information processing system, and information processing method
JP2013101528A5 (en)
JP2013206322A5 (en)
JP2013235373A5 (en)
JP2012165174A5 (en) Image display control device, imaging device, display control method, and control program
EP2458478A3 (en) Information processing device, information processing method, and computer program product
JP2013257762A5 (en)
JP2013105285A5 (en)
JP2013167941A5 (en)
EP2565848A3 (en) Program, information processing apparatus, information processing system, and information processing method
JP2013007921A5 (en)

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: A63F 13/10 20060101AFI20130925BHEP

17P Request for examination filed

Effective date: 20131122

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20140124

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602012002417

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: A63F0013100000

Ipc: A63F0013500000

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

RIC1 Information provided on ipc code assigned before grant

Ipc: A63F 13/50 20140101AFI20140611BHEP

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 677215

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140815

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602012002417

Country of ref document: DE

Effective date: 20140828

REG Reference to a national code

Ref country code: NL

Ref legal event code: VDEP

Effective date: 20140716

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 677215

Country of ref document: AT

Kind code of ref document: T

Effective date: 20140716

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141117

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141017

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141016

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141016

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20141116

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 602012002417

Country of ref document: DE

PLBI Opposition filed

Free format text: ORIGINAL CODE: 0009260

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

26 Opposition filed

Opponent name: BIGBEN INTERACTIVE SA

Effective date: 20150415

PLAX Notice of opposition and request to file observation + time limit sent

Free format text: ORIGINAL CODE: EPIDOSNOBS2

REG Reference to a national code

Ref country code: DE

Ref legal event code: R026

Ref document number: 602012002417

Country of ref document: DE

Effective date: 20150415

PLAF Information modified related to communication of a notice of opposition and request to file observations + time limit

Free format text: ORIGINAL CODE: EPIDOSCOBS2

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PLBB Reply of patent proprietor to notice(s) of opposition received

Free format text: ORIGINAL CODE: EPIDOSNOBS3

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20150601

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150601

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150630

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20150630

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20120601

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PLCK Communication despatched that opposition was rejected

Free format text: ORIGINAL CODE: EPIDOSNREJ1

REG Reference to a national code

Ref country code: DE

Ref legal event code: R100

Ref document number: 602012002417

Country of ref document: DE

PLBN Opposition rejected

Free format text: ORIGINAL CODE: 0009273

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: OPPOSITION REJECTED

27O Opposition rejected

Effective date: 20171006

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 7

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20140716

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230428

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230510

Year of fee payment: 12

Ref country code: DE

Payment date: 20230502

Year of fee payment: 12

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230427

Year of fee payment: 12