EP3035326B1 - Encoding, transmission , decoding and displaying of oriented images - Google Patents

Encoding, transmission , decoding and displaying of oriented images Download PDF

Info

Publication number
EP3035326B1
EP3035326B1 EP14307109.0A EP14307109A EP3035326B1 EP 3035326 B1 EP3035326 B1 EP 3035326B1 EP 14307109 A EP14307109 A EP 14307109A EP 3035326 B1 EP3035326 B1 EP 3035326B1
Authority
EP
European Patent Office
Prior art keywords
image
display device
oriented
composite image
orientable
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Not-in-force
Application number
EP14307109.0A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP3035326A1 (en
Inventor
Sigurd Van Broeck
Rafaël Huysegems
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alcatel Lucent SAS
Original Assignee
Alcatel Lucent SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alcatel Lucent SAS filed Critical Alcatel Lucent SAS
Priority to EP14307109.0A priority Critical patent/EP3035326B1/en
Priority to CN201580068152.8A priority patent/CN107004027A/zh
Priority to PCT/EP2015/079796 priority patent/WO2016096860A1/en
Priority to US15/535,603 priority patent/US20170337903A1/en
Priority to JP2017532806A priority patent/JP6557343B2/ja
Publication of EP3035326A1 publication Critical patent/EP3035326A1/en
Application granted granted Critical
Publication of EP3035326B1 publication Critical patent/EP3035326B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
    • G09G5/32—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory with means for controlling the display position
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/161—Indexing scheme relating to constructional details of the monitor
    • G06F2200/1614—Image rotation following screen orientation, e.g. switching from landscape to portrait mode
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0492—Change of orientation of the displayed image, e.g. upside-down, mirrored
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/14—Solving problems related to the presentation of information to be displayed
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/02—Networking aspects
    • G09G2370/027—Arrangements and methods specific for the display of internet documents

Definitions

  • the field of the invention relates to displaying oriented images on an orientable display device.
  • Particular embodiments relate to a method and an orientable display device for displaying an oriented image; a method and an image encoder for encoding a composite image; a method and a content server for providing a composite image to an orientable display device; and a computer program product.
  • RWD Responsive Web Design
  • the plethora of display devices with different form factors like e.g. TVs, PCs, tablets, smartphones and smartwatches calls for Responsive Web Design (RWD) allowing the user agent to adapt the content to the display device's characteristics.
  • RWD Responsive Web Design
  • Such adaptations are applied on page layout and style but also on images.
  • a single reference image is therefore cropped, sized, and art directed by the developer(s) of a Web application in order to provide a set of images adapted to a set of display device characteristics.
  • the user agent is then able to automatically select the image from the set of images (e.g ., listed in a manifest file) that best suits the display device's characteristics.
  • the Web application's RWD will change. This may impact the image selection process and therefore the image selected from the set of authored images listed in the manifest file.
  • This image selection process is handled by the Web application developer using e.g . JavaScript. In that case, Web application developers typically resort to requesting a new image with a different orientation.
  • EP 2 091 242 A1 discloses a digital television broadcast system and mobile telephone, in which content of a data broadcast can be checked with a small marquee display area in a horizontally long display state, and in which checking desired content in detail is easy by switching the display screen to a vertically long display state, while an extracted character string to be displayed is automatically selected.
  • EP 0 983 552 A1 discloses a system and method for parameterized image orientation for computer displays, accommodating several image orientation modes in a single software driver utilizing the same software instructions for each orientation mode in order to transfer image information to display memory, by using parameters (set at the time an orientation mode is selected) to determine where each successive pixel of information should go in the display memory, allowing the same instructions to be used for each mode.
  • US 2008/266326 A1 discloses a method for automatic image reorientation in response to a change in relative orientation of a viewer image with respect to a reference image, which reorientation is performed to compensate, at least partially, for the change in relative orientation of the viewer image.
  • EP 2 784 654 A1 discloses a mobile terminal apparatus comprising an image storage device for storing first and second groups of medical diagnostic images. When a motion of the apparatus is detected by accelerometers/gyroscopes, the image of the same group or different group are shown according to the motion.
  • Other objects of embodiments of the present invention are to decrease storage requirements for storing images, and adhering to the paradigms of Responsive Web Design (RWD).
  • a method for displaying on an orientable display device an oriented image from at least one content server according to the wording of claim 1.
  • the word 'orientable' is taken to mean that an object, such as a display device, 'can be oriented', i.e., can be rotated from and to a certain orientation.
  • the word 'orienting' something is taken to mean that something is aligned or positioned relative to other specified positions.
  • the word 'positioning' is taken to mean that something is put or arranged in a particular place or way.
  • the display device can intelligently extract from that composite image an oriented image that best corresponds with its determined display device parameters. This requires no extra data transmission and request processing beyond said receiving and said extracting. Since this improves user experience on the basis of a single file, and since no additional Web application programming logic is required, this also adheres to the paradigms of RWD.
  • the method comprises requesting an image from said content server. Said receiving is performed in response to said requesting.
  • a method for encoding a composite image according to claim 4.
  • the skilled person will understand that the hereinabove described considerations and advantages also apply for embodiments of the method for encoding a composite image, mutatis mutandis.
  • embodiments of the method for encoding a composite image may produce an electronic image file format holding said composite image, allowing easy transport and manipulation.
  • embodiments of the method for providing a composite image may obtain said composite image from an entity, such as an image encoder, performing the steps of an embodiment of the method for encoding a composite image.
  • said composite image comprises a plurality of separate oriented images.
  • the oriented images are separate from each other, i.e. stored independently within a composite image functioning as a container, they can be extracted independently from other oriented images.
  • said composite image comprises a plurality of orientation indicators; and wherein each of said oriented images is associated with a corresponding orientation indicator indicating its respective orientation.
  • said composite image comprises a plurality of entropy-coded oriented images, at least one of which contains at least one reference to at least one substantially equal part of at least one other of said plurality of entropy-coded oriented images. Additionally or alternatively, said composite image comprises at least one base image and at least one corresponding difference image, each difference image containing at least one image portion different from its corresponding base image. Additionally or alternatively, said composite image comprises at least one partial image and at least one corresponding composition indication indicating a positioning for its corresponding partial image.
  • a computer program product comprising computer-executable instructions for performing a method when the program is run on a computer, the method comprising the steps of any one of the methods described hereinabove.
  • Embodiments according to the invention therefore propose the use of a new image format, viz. a composite image, comprising information representing a plurality of oriented images relating preferably to a single subject-matter, each oriented image representing a differently oriented region of said composite image.
  • an opportune oriented image can be extracted and displayed, depending on one or more display device parameters of an orientable display device, without having to separately transmit multiple images.
  • a composite image whose oriented images relate preferably but not necessarily to a single subject-matter, it is possible to extract and display one or more oriented images in a useful manner (i.e ., filling the display of the display device in a more effective manner when displayed) depending on such display device parameters, corresponding to user expectations that the display device displays a suitably moved region of the composite image being viewed when handling a display device using continuous movements.
  • each oriented image represent a differently oriented region of said composite image, it is possible to extract and display an opportune oriented image representing a correspondingly oriented region of the composite image depending on such display device parameters.
  • Figure 1 shows a system comprising an orientable display device 1, with a display 4.
  • the orientable display device 1 has an orientation 5.
  • the orientable display device 1 may contain a fixed display 4, such that orienting the orientable display device 1 as a whole necessarily also orients the fixed display 4, or that the orientable display device 1 may contain a separately orientable display 4, such that the separately orientable display 4 may be oriented independently from the orientable display device 1 as a whole.
  • the latter may for instance be the case for smartwatches with an orientable top display.
  • Figure 1 further shows that the system comprises a first content server 2A and a second content server 2B.
  • the orientable display device 1 is connected to the first content server 2A via a connection 6A, and the first content server 2A is connected to the second content server 2B via a connection 6B.
  • the second content server 2B comprises an image encoder 3, and is connected to a data storage 7.
  • only a single content server, say content server 2B, may be present, and connections 6A and 6B may be joined without a logical interruption.
  • the orientable display device 1 requests an image from the first content server 2A, which does not store the relevant image.
  • the first content server 2A requests the image in turn from the second content server 2B.
  • the second content server 2B happens to comprise an image encoder 3 that is configured to encode a composite image 9 comprising information representing a plurality of oriented images relating preferably to a single subject-matter and corresponding to a plurality of differently oriented regions of said composite image 9.
  • the image encoder 3 may be configured to encode a composite image comprising information representing a plurality of oriented images not relating to a single subject-matter.
  • the image encoder 3 may have already encoded the composite image 9 beforehand, and it may have already been stored in the data storage 7.
  • the second content server 2B obtains the composite image 9 from the data storage 7, and transmits it via the first content server 2A over connections 6B and 6A, ultimately to the orientable display device 1.
  • the second content server 2B may obtain the composite image 9 directly from the image encoder 3, and choose whether or not to store the composite image 9 in the data storage 7 for future ease of access.
  • the first content server 2A may choose whether or not to store a local copy of the composite image 9 for future ease of access.
  • the orientable display device 1 thus receives the composite image 9.
  • the orientable display device 1 determines at least one display device parameter, such as the display device orientation 5, using e.g.
  • the orientable display device 1 extracts from the composite image 9 an oriented image that best corresponds to the current conditions of the orientable display device 1. For example, the portrait oriented image 9A may be extracted and displayed on display 4, since its orientation 10A may best correspond momentarily to the determined display device orientation 5, thus providing the best viewing experience for a user of the orientable display device 1.
  • Display device parameters than the display device orientation 5, may comprise any one or more of the following: a display device visible screen region, a display device rotation speed, a display device rotation acceleration, a display device panning direction, a display device panning speed, and a display device panning acceleration.
  • the display device orientation 5 may be represented as an angle relative to the horizontal, but may also be represented as an angle relative to the vertical, to magnetic earth fields, and/or (in space) relative to the sun's position or to the user's position relative to a beacon.
  • the orientable display device 1 may detect changes in the at least one display device parameter - in particular, it may detect a change in the display device orientation 5, and in response to detecting that change, it may extract another, better suited oriented image (say, oriented image 9B) from the composite image 9 and displayed on display 4. Since the composite image has already been requested and received, there is no need to request a new transmission of data, but it is possible to extract another oriented image from the composite image 9.
  • oriented image 9B better suited oriented image
  • Figure 1 further also shows an example schematic representation of the composite image 9.
  • the composite image 9 comprises information representing a plurality of oriented images 9A-C.
  • Each oriented image 9A-C is related preferably to a single subject-matter, meaning that each oriented image depicts a differently oriented region of preferably the same general scene.
  • the images 9A-C may relate to more than one subject-matter.
  • Each oriented image 9A-C shown in this example has an angular orientation 10A-C, along two dimensional axes 8B-C.
  • the oriented image 9A is shown in portrait orientation 10A
  • the oriented image 9B is shown in landscape orientation 10B
  • the oriented image 9C is shown in a diagonal orientation 10C.
  • three oriented images 9A-C are represented within the composite image 9.
  • there may be two oriented images represented within the composite image for example in particular a portrait oriented image and a landscape oriented image.
  • there may be four or more oriented images represented within the composite image for example a portrait oriented image, a landscape oriented image, and an oriented image for every 15° step orientation between portrait and landscape, such that the composite image supports more fine-grained orientations of the orientable display device 1.
  • the composite image may comprise a plurality of orientation indicators, and each oriented image may be associated with a corresponding orientation indicator that indicates its respective orientation.
  • Example orientation indicators may comprise bivalent, trivalent or higher-valence indications: for example the string indications 'portrait', 'landscape' , 'left-diagonal' and 'right-diagonal'; or the degree indications '0°', '90°', '45°', and '135°', and even '15°', '30°', '60°', '75°', etc.; or simply the integer indications '0', '1' and '2', if these indications have been suitably pre-defined to correspond to orientations of, say, 'portrait', 'landscape' and 'diagonal' respectively.
  • the composite image may be a new container file format or an existing container file format (e.g., a RIFF (Resource Interchange File Format) or GIF (Graphics Interchange Format) container or a CSS (Cascading Style Sheets) sprite) containing multiple oriented images in existing image file formats.
  • a RIFF Resource Interchange File Format
  • GIF Graphics Interchange Format
  • CSS CSS
  • the order in which the oriented images appear in the container may be pre-defined.
  • the portrait oriented image may for example be provided first, followed by the landscape oriented image, followed by the 45° image, followed by the 315° (-45°) image, etc.
  • Each oriented image may be associated with an image orientation indicator.
  • the image orientation indicators for a certain container as specified above may be provided in a separate file, or may be linked to each corresponding oriented image within the composite image.
  • the hints when there is an overlap between a landscape and a portrait oriented image in the CSS sprite composite image containing both oriented images, the hints will define both areas as common.
  • An example is provided below.
  • the composite image may contain the portrait oriented image first, followed by the difference images between the portrait and the landscape oriented image, followed (or preceded) by a description of the portion of the portrait oriented image that is not used in the landscape oriented image, or vice versa.
  • Figure 2 illustrates an example composite image 40 for use in embodiments of a method according to the invention.
  • a composite image 40 is shown with a matrix division of rows 41-43 and columns 44-46, in which information representing a portrait oriented image 45 and a landscape oriented image 42 is comprised.
  • the difference image between the portrait oriented image 45 and the landscape oriented image 42 would be sections 21 and 23, while the portions not used in landscape mode would be 12 and 32.
  • Figure 3 illustrates another example composite image 40 for use in embodiments of a method according to the invention.
  • composite image 40 with a matrix division of rows 41-43 and columns 44-46 comprises information representing two oriented images, viz . a portrait oriented image comprising the sections 12, 13, 22, 23, 32 and 33; and a landscape oriented image comprising the sections 21 and 22 ( i.e., not section 23, in this example).
  • the difference image between the portrait oriented image and the landscape oriented image would be section 21, whereas the portions not used in landscape mode would be 12, 13, 23, 32 and 33.
  • the unique as well as the overlapping parts of the oriented images are provided in the composite image and information on the composition of the individual oriented image parts is provided as well.
  • part 11 does not belong to any mode
  • part 12 belongs to portrait mode
  • part 21 belongs to landscape mode
  • part 22 belongs to portrait and landscape mode.
  • all entire columns may be used for portrait mode
  • all entire rows may be used for landscape mode.
  • the composite image may contain the overlapping image that is the common part between the portrait oriented image and the landscape oriented image, followed by the difference image between the common image and the landscape oriented image, followed by the difference image between the common image and the portrait oriented image, followed by a location indicator (e.g . a pixel offset in horizontal or vertical direction for the landscape oriented image or the portrait oriented image respectively) for each of the oriented images indicating where the common part should be inserted.
  • the pixels for the common part in the images may all be a single colour (e.g. black) and/or 100% transparent.
  • Figure 6 illustrates schematically two embodiments of methods according to the present invention.
  • an embodiment of a method for displaying an oriented image on an orientable display device 1 is illustrated.
  • an embodiment of a method for providing a composite image to an orientable display device 1 is illustrated, as performed at, for example, a content server 2A. Also, the inter-relationship between these two embodiments is illustrated.
  • Device 1 determines 78 one or more display device parameters. This may be done prior to receiving 77 the composite image, concurrently, or afterwards, and may be repeated as necessary.
  • the embodiment illustrated here also comprises a step wherein device 1 detects 81 change or changes in the display device parameters of device 1. If a change or changes is/are detected, device 1 again extracts 79 and displays 80 an oriented image accordingly.
  • Oriented image 94 represents a region of the composite image 90 that is rotated clockwise with respect to oriented image 93. If a user has moved an orientable display device in a rotation movement in a clockwise manner while displaying oriented image 91, then the display device could have detected a change in its orientation and could have extracted a new, more opportune oriented image 94, such that the display of the display device retains a sensible and useful picture of the composite image 90.
  • translation and rotation may also be combined, and that other types of input to or condition of the orientable display device may also alternatively or additionally be used to extract and display one or more oriented images of the composite image.
  • oriented image 94 happens to extend with a part 94A outside of the boundaries of the composite image 90.
  • Certain embodiments of the method may compensate for such an eventuality by substituting a different part 94B of the composite image 90, such that the oriented image 94 that is extracted and displayed by the orientable display device retains as much useful picture area as possible.
  • Other embodiments may alternatively indicate that part 94A is unavailable by displaying it in a different manner, for example as a black or white area.
  • program storage devices e.g. digital data storage media, which are machine or computer readable and encode machine-executable or computer-executable programs of instructions, wherein said instructions perform some or all of the steps of said above-described methods.
  • the program storage devices may be, e.g. digital memories, magnetic storage media such as magnetic disks and magnetic tapes, hard drives, or optically readable digital data storage media.
  • the embodiments are also intended to cover computers programmed to perform said steps of the above-described methods.
  • processors may be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software.
  • the functions may be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which may be shared.
  • explicit use of the term "processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, network processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), read only memory (ROM) for storing software, random access memory (RAM), and non volatile storage.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • FPGA field programmable gate array
  • ROM read only memory
  • RAM random access memory
  • any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the implementer as more specifically understood from the context.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
EP14307109.0A 2014-12-19 2014-12-19 Encoding, transmission , decoding and displaying of oriented images Not-in-force EP3035326B1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP14307109.0A EP3035326B1 (en) 2014-12-19 2014-12-19 Encoding, transmission , decoding and displaying of oriented images
CN201580068152.8A CN107004027A (zh) 2014-12-19 2015-12-15 定向图像的编码、传输、解码和显示
PCT/EP2015/079796 WO2016096860A1 (en) 2014-12-19 2015-12-15 Encoding, transmission, decoding and displaying of oriented images
US15/535,603 US20170337903A1 (en) 2014-12-19 2015-12-15 Oriented image encoding, tranmission, decoding and displaying
JP2017532806A JP6557343B2 (ja) 2014-12-19 2015-12-15 配向化画像符号化、送信、復号および表示

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14307109.0A EP3035326B1 (en) 2014-12-19 2014-12-19 Encoding, transmission , decoding and displaying of oriented images

Publications (2)

Publication Number Publication Date
EP3035326A1 EP3035326A1 (en) 2016-06-22
EP3035326B1 true EP3035326B1 (en) 2019-07-17

Family

ID=52394056

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14307109.0A Not-in-force EP3035326B1 (en) 2014-12-19 2014-12-19 Encoding, transmission , decoding and displaying of oriented images

Country Status (5)

Country Link
US (1) US20170337903A1 (ja)
EP (1) EP3035326B1 (ja)
JP (1) JP6557343B2 (ja)
CN (1) CN107004027A (ja)
WO (1) WO2016096860A1 (ja)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12008034B2 (en) 2016-02-15 2024-06-11 Ebay Inc. Digital image presentation
US9864925B2 (en) * 2016-02-15 2018-01-09 Ebay Inc. Digital image presentation

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2784654A1 (en) * 2013-03-25 2014-10-01 FUJIFILM Corporation Mobile terminal apparatus with display unit

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5448372A (en) * 1991-12-18 1995-09-05 Eastman Kodak Company Storage and retrieval of digitized photographic images
US5973664A (en) * 1998-03-19 1999-10-26 Portrait Displays, Inc. Parameterized image orientation for computer displays
KR100676328B1 (ko) * 2000-06-28 2007-01-30 삼성전자주식회사 피아이피 기능을 갖는 디지탈 영상표시기기의 피봇장치
KR100651938B1 (ko) * 2004-08-16 2006-12-06 엘지전자 주식회사 영상 배향 제어장치, 방법 및 매체
JP4687279B2 (ja) * 2005-06-29 2011-05-25 ソニー株式会社 画像再生装置、画像再生方法、および画像再生用プログラム
US8140059B2 (en) * 2006-12-13 2012-03-20 Sharp Kabushiki Kaisha Portable information terminal device
US20080266326A1 (en) * 2007-04-25 2008-10-30 Ati Technologies Ulc Automatic image reorientation
JP5413250B2 (ja) * 2010-03-05 2014-02-12 ソニー株式会社 画像処理装置、画像処理方法およびプログラム
US9256974B1 (en) * 2010-05-04 2016-02-09 Stephen P Hines 3-D motion-parallax portable display software application
JP5811602B2 (ja) * 2010-12-16 2015-11-11 ソニー株式会社 画像生成装置、プログラム、画像表示システム、および画像表示装置
US8872855B2 (en) * 2011-07-21 2014-10-28 Flipboard, Inc. Adjusting orientation of content regions in a page layout
US8854397B2 (en) * 2011-12-13 2014-10-07 Facebook, Inc. Photo selection for mobile devices
US20130155305A1 (en) * 2011-12-19 2013-06-20 Sony Corporation Orientation of illustration in electronic display device according to image of actual object being illustrated
WO2013094211A1 (ja) * 2011-12-21 2013-06-27 パナソニック株式会社 表示装置
JP5872923B2 (ja) * 2012-02-22 2016-03-01 株式会社マイクロネット Ａｒ画像処理装置及び方法
JP6149862B2 (ja) * 2012-08-27 2017-06-21 ソニー株式会社 表示制御装置、表示制御システムおよび表示制御方法
KR101843328B1 (ko) * 2012-10-26 2018-03-28 인텔 코포레이션 비디오 방향 조정(cvo)를 갖는 스트리밍
US9530187B2 (en) * 2013-06-13 2016-12-27 Apple Inc. Controlling element layout on a display
KR102296853B1 (ko) * 2013-07-12 2021-09-01 소니그룹주식회사 화상 복호 장치 및 방법
AU2014291253B2 (en) * 2013-07-19 2018-07-05 Sony Corporation Information processing device and method
EP3206408B1 (en) * 2014-10-10 2020-12-30 Sony Corporation Encoding device and method, playback device and method, and program

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2784654A1 (en) * 2013-03-25 2014-10-01 FUJIFILM Corporation Mobile terminal apparatus with display unit

Also Published As

Publication number Publication date
CN107004027A (zh) 2017-08-01
EP3035326A1 (en) 2016-06-22
WO2016096860A1 (en) 2016-06-23
US20170337903A1 (en) 2017-11-23
JP2018507580A (ja) 2018-03-15
JP6557343B2 (ja) 2019-08-07

Similar Documents

Publication Publication Date Title
US20210074051A1 (en) Systems and methods for displaying representative images
US11941762B2 (en) System and method for augmented reality scenes
US8917286B2 (en) Image processing device, information processing device, image processing method, and information processing method
US10521468B2 (en) Animated seek preview for panoramic videos
CN106537894A (zh) 用于回放全景视频内容的系统和方法
TW201730841A (zh) 圖像資料處理系統和相關方法以及相關圖像融合方法
US10049490B2 (en) Generating virtual shadows for displayable elements
US20200264695A1 (en) A cloud-based system and method for creating a virtual tour
US20130050198A1 (en) Multi-directional display
CN103649908A (zh) 用户界面操纵的异步处理
CN101640762A (zh) 信息处理设备、方法和程序
CN111031293B (zh) 全景监控的展示方法、装置和系统及计算机可读存储介质
CN104040457A (zh) 移动显示设备
CN106447788B (zh) 观看视角的指示方法及装置
US9349350B2 (en) Method for providing contents along with virtual information and a digital device for the same
CN102945563A (zh) 一种全景视频的展示与交互系统及方法
WO2012072741A1 (en) System and method for presenting images
EP3035326B1 (en) Encoding, transmission , decoding and displaying of oriented images
KR100750670B1 (ko) 3차원 영상을 2차원 영상으로 변환하여 표시하는 방법
CN109814703B (zh) 一种显示方法、装置、设备和介质
US20120162199A1 (en) Apparatus and method for displaying three-dimensional augmented reality
US11962743B2 (en) 3D display system and 3D display method
WO2013142725A1 (en) Multi-directional display
CN118037913A (zh) 书籍展示方法、装置、电子设备以及存储介质
CN115690269A (zh) 一种视图对象的处理方法及电子设备

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20161222

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180115

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: ALCATEL LUCENT

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20181024

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTG Intention to grant announced

Effective date: 20190225

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602014050087

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1156571

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190815

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20190717

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1156571

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191017

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191017

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191118

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20191203

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191018

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191117

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20191219

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200224

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602014050087

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG2D Information on lapse in contracting state deleted

Ref country code: IS

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20200603

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191219

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191231

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602014050087

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20141219

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20201219

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20201219

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190717