GB2459971A - A display apparatus producing two axially-separated, interacting images - Google Patents

A display apparatus producing two axially-separated, interacting images Download PDF

Info

Publication number
GB2459971A
GB2459971A GB0908168A GB0908168A GB2459971A GB 2459971 A GB2459971 A GB 2459971A GB 0908168 A GB0908168 A GB 0908168A GB 0908168 A GB0908168 A GB 0908168A GB 2459971 A GB2459971 A GB 2459971A
Authority
GB
United Kingdom
Prior art keywords
display
image
primary
screen
display apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB0908168A
Other versions
GB0908168D0 (en
Inventor
Paul Andrew
Simon Humphreys
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ACTIV8 3D Ltd
Original Assignee
ACTIV8 3D Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ACTIV8 3D Ltd filed Critical ACTIV8 3D Ltd
Publication of GB0908168D0 publication Critical patent/GB0908168D0/en
Publication of GB2459971A publication Critical patent/GB2459971A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00Special procedures for taking photographs; Apparatus therefor
    • G03B15/08Trick photography
    • G03B15/12Trick photography using mirrors
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02Viewing or reading apparatus
    • G02B27/022Viewing apparatus
    • G02B27/024Viewing apparatus comprising a light source, e.g. for viewing photographic slides, X-ray transparancies
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • G02B30/56Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B21/00Projectors or projection-type viewers; Accessories therefor
    • G03B21/14Details
    • G03B21/28Reflectors in projection beam
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00Advertising or display means not otherwise provided for
    • G09F19/12Advertising or display means not otherwise provided for using special optical effects
    • G09F19/16Advertising or display means not otherwise provided for using special optical effects involving the use of mirrors

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

A display apparatus comprising a means 31 for producing a primary image, means 32 for producing a secondary image, and an inclined partially reflective screen 23 interposed in the optical path of the secondary display. The screen is situated so that light from the means for producing the secondary image is reflected by the screen and is superimposed along the optical path for the primary image so as to produce a virtual display located tothe optical rear of the primary image as seen by a viewer. The primary and secondary images could interact to produce a three dimensional image. The source of the secondary image could be a computer or a standard lights source.

Description

DISPLAY APPARATUS
This invention relates to display apparatus.
Many forms of display apparatus are known.
One such display apparatus involving the combined effects of light transmission and reflection is commonly known as Pepper's ghost'.
One of the problems in relation to the known traditional Pepper's ghost apparatus is that it inherently involves apparatus occupying considerable space in relation to the observed viewable size of the images being presented/produced by the apparatus.
It is an object of the present invention to provide a Pepper's ghost type/form of display apparatus that is less demanding on space as compared with known apparatus providing similarly sized images to the viewer.
Broadly according to a first aspect of the invention there is provided a display apparatus in which a primary image and a virtual secondary image are required to interact, wherein in operation the plane of the primary image is effectively located along the viewing direction of the virtual secondary image plane in advance of the virtual image plane.
A further aspect of the invention provides a display apparatus in which a primary image and a secondary reflected image are transmitted onto a projection screen by the use of projector(s) and/or LCD(s)/plasma(s), thus creating a primary image on the projection screen and a secondary reflected image behind the primary image. S -2-
in accordance with a second aspect of the invention there is prvided a display apparatus including means for displaying a primary image/object, means for displaying a secondary image/object, an inclined partially reflective screen interposed in the optical path of the secondary image/object of the display in such manner that light reflected by the screen is superimposed along the optical path for the primary display so as to produce a composite three dimensional virtual display optically located to the optical rear of the primary display.
Preferably the primary display is produced by a image display means arranged to produce a image in a plane transverse to a viewing axis of the apparatus, and the primary display plane.
For a better understanding of the invention and to show how to carry the same physical reference will now be made to the accompanying drawings in which;-Figure 1 very schematically illustrates the principles of known arrangement for Pepper's ghost apparatus, 1 5 Figure 2 schematically illustrates in a similar manner a first embodiment arrangement for Pepper's ghost apparatus incorporating the concepts of the present invention and Figure 3 schematically illustrates in a similar manner a further embodiment arrangenent for Pepper's ghost apparatus incorporating the concepts of the present invention.
Referring now to Figure 1 the apparatus shown therein includes a housing 1 that is schematically represented by a horizontal section 2 and a vertical section 3 that is beneath the horizontal section 2.
The horizontal section 2 has a rear end wall 4, a base 5, side walls 6 a top 7 and a front wall 8. This front wall 8 is formed by a transparent viewing window. The -.3-vertical section is connected to the base 5 as indicated in the Figure. The vertical section includes a base 9 and upstanding walls 10 whose upper edges connect with the base 6 of the horizontal section 2. As so far discussed the assembly of the two sections 2 and 3 effectively forms as hollow L shaped housing..
A partially reflective screen 11 that is inclined at an angle of approximately 45 degrees to the vertical is provided at the region of the intersection of the two sections 2 and 3.
The relative dimensions of the two sections 2 and 3 and the screen 11 are such that a horizontal central plane 12 extending lerigtbways of the horizontal section 2 is intersected by the vertical central plane 13 of the vertical section 3 and with the central region 14 of the screen.
With this arrangement the region 14 point of intersection of the aforesaid planes and that of the screen Li defines the position of the viewing optical axis of the Pepper's ghost apparatus.
Conveniently, if considered appropriate for a particular embodiment of the apparatus the interior of the two sections can be suitably coated/covered with ablack non reflecting coating/covering.
At the base of the vertical section 3 there is located means (not shown) for providing a primary display that it is desired to display/exhibit by use of the apparatus.
This primary display image can be a static image or object or a dynamic/moving image or object.
As seen in the Figure 1 a portion of he light of the primary image appearing at the screen 11 is reflected by the screen towards the left hand side of the Figure where it can be viewed by a person appropriately positioned with respect to the aforementioned optical axis. The remainder of such light passes through the
S
screen 11.
As a result of the positioning and the inclination of the screen the display that a viewer sees when looking towards the screen will appear as a virtual display 15 located at a distance behind the screen 11 effectively equal to the distance between the centre of the screen 11 and the position of the primary display source located at the base 9 of the vertical section.
Since it is normally required to view such an image in conjunction with a secondary image whose source 16 is located optically to the rear of the primary virtual image position, In Figure 1 this secondary image source 16 is located at the right hand end of the horizontal 2 of the housing 1. As a result since this second image is located further to the rear of the screen 11 it significantly increases the overall length of the housing and the complexity of its construction of the apparatus.
In practice, it has been found for many applications of apparatus such as discussed in relation to Figure 1 that the length of the apparatus can introduce inherent disadvantages in some such applications particularly where space for locating apparatus for use andlor transportation of the apparatus, and storage of the apparatus etc. is limited.
It has been found that apparatus incorporating the concepts of the present invention enables a significant reduction in the overall size of the apparatus. Thus it has been found that by significantly varying the optical arrangements of the apparatus as\compared with hitherto known arrangements the overall length of the apparatus can be reduced as is indicated in the embodiment of the apparatus schematically shown in relation to Figure 2 which can be regarded as illustrating a Pepper's ghost apparatus incorporating the concepts' of the The Figure 2 embodiment can be considered as comprising a housing 20 in the form of a single hollow closed container separated into upper and lower sections 21 and 22 by means of an inclined partially reflective screen 23 that is inclined to the horizontal at an angle of 45 degrees.
As shown, the housing upper section 21 includes a rear wall 24 (as represented in the Figure), a top 25, side walls 26, and a front wall 27, whilst the lower section 22 includes a base 28, side walls which are actually continuations of the side waIls 26 of the upper section, a rear wall that is a continuation of the upper section rear wall 24, and a front wall that is a continuation of the front wall 27. The portion of the front wall 27 associated with the upper section 21 is formed by a transparent viewing screen.
With this arrangement the primary display image 29 is located at the rear wall 24 of the upper section 2.
It will be appreciated that the front to rear dimensions of the housing 20 are selected such that the wall 24 is located at the appropriate optical distance from the screen 23 that enables a viewer located at the intended viewing position 30 to observe the primary display image 29 by looking directly though the transparent region of the front waIl 27 into the interior of the housing 20.
This primary display image is producible by directing the output from a LCD/Plasma apparatus 31 located at the base 28 of the housing The secondary display image which is to be associated with the primary display image can be produced either by means of a display means source 32, such as, for example, a media player such as a laptop or note book, or a dynamic image producing means located in the vicinity of the top 25 of the upper section 21 of the housing and in such position that its display may be seen by the viewer following reflection by the inclined screen 23.
The production of the primary display image involves the provision of a projector 33 located near the top of the upper section 21 which projector is arranged to project an image serving as the primary image direct onto the rear wall 24 of the housing The production of this image is very schematically represented by diverging lines 34.
The first mentioned mode of producing the secondary image, by reason of it being reflected by the screen 23, takes the form of a virtual display that is located in a plane that is displaced along the optical axis of the viewing direction relative to the plane of the primary image. As a consequence the viewer observes a three dimensional representation of the combined primary and secondary images located to the rear of the plane of the virtual display.
The secondary image by reason of its association with the screen 23 inclined at 45degrees to the horizontal will appear to the viewer at the viewing position 30 as 1 5 though it is located at the back of the apparatus and will in practice be optically positioned behind the primary image 29. That is to say the virtual image of the apparatus is located in a plane parallel to the plane of the rear wall 24 of the apparatus.
Referring now to the embodiment illustrated in Figure 3, as in the case of the Figure 2 embodiment, the Figure 3 embodiment comprises a housing 20, with a top 25, a bottom 28, a rear wall 24, and a front wall 22.provided with a transparent viewing region.
In the Figure 3 embodiment the positions of the LCD/plasmas 32 and the units 32/33 are effectively interchanged. Thus, as may be noted from
S
Figure 3 the output from the media player unit 32 is reflected by the inclined screen 23 towards the rear wall of the housing whilst the output from the unit 31 at the top of the housing is likewise reflected by the screen in such manner that as seen by a viewer at 30 a secondary image is produced at a plane located to the rear of the primary image plane.. The distance, as in the case of the Figure 2 embodiment, between the primary and secondary images can be regarded as the virtual image depth.
Whilst in relation to the above discussed embodiments of Figures 2 and 3 the inclination of the screen has been stated to be 45 degrees the angle of inclination can be other than 45 degrees and be within an angular range of do 90 degrees.
With a view to providing the facility, where required, of illuminating the interior of the housing lights 36 are provided in the interior of the housings 24.
It will be appreciated that the distance separation between the primary and secondary images produces as seen by the viewer a three dimensional image.
As is indicated in Figure 3 the over all length of the housing is reduced as compared with the embodiment shown in Figure 2. In addition the sense of the inclination of the screen 23 illustrated in Figure 3 is reversed as compared with the inclination of the screen of the Figure 2 embodiment.
As is shown in Figure 3 an LCD/plasma arrangement 24 can be positioned behind the position of the primary image plane so as to provide the source of the primary image.
In general the apparatus above discussed is one in which a primary image and a secondary reflected image are transmitted onto a projection screen by the use of projector(s) and/or LCD(s)/plasma(s), thus creating a primary image on the projection screen and a secondary reflected image behind the primary image.
Thus from he forgoing it will be noted that the concepts of the invention provides display apparatus including means for displaying a primary image, means for displaying a secondary image which appears to be created in virtual space behind the apparatus, and the use of a partially reflective screen which can be inclined at a desired angle such as 45 degrees, to create a secondary front image which appears to be in three dimensions, and a secondary video background which creates virtual depth behind the primary image. The light reflected by the screen is superimposed in the optical path for the primary display so as to produce a composite three dimensional virtual display optically located to the optical rear of the primary display.
In practice it has been found that since the partial reflectivity of partially reflective materials typically have a reflectance value of some l2% and a transmission value of 84% the brightness of what (in the Figure 1 arrangement) is considered to be the virtual image is increased by a factor of 7 since the images directly associated with the inclination of the screen are in practical terms reversed so that the brightness of the secondary image is correspondingly reduced by a factor of 7.
As may be noted from the Figures 2 and 3 the virtual display is located to the rear and effectively behind the physical rear of the actual apparatus. The distance between the primary and secondary images can conveniently be regarded \as defining a virtual image depth for the images involved..
Thus as a result of the proposals of the present invention the physical depth of the housing for the apparatus can be more than halved as compared with known apparatus thereby resulting in a compact installation presenting a relatively biight primary display without undesirable compromising of the perceived Pepper's ghost 3 dimensional effect From the above it will be noted that a Pepper's ghost apparatus incorporating a single in-line housing construction greatly facilitates the construction of such apparatus in so far as the size and the visual shape of the housing are concerned

Claims (9)

  1. CLAIMS1. A display apparatus, including means for producing a primary image and means for producing a secondary reflected image are arranged to transmit said images onto a projection screen in such manner as to create a primary image on the projection screen and a secondary reflected image at a location behind the primary image.
  2. 2. A display apparatus as claimed in claim 1, wherein said images are arranged to be transmitted by means of projector(s) and br LCD(s)
  3. 3. A display apparatus as claimed in claim 1 or 2, wherein the primary display image is arranged to be produced by an image display means arranged to produce an image in a plane transverse to a viewing axis of the apparatus, and the primary image plane.
  4. 4. A display apparatus as claimed in claim 1,2 or 3,and wherein the secondary display which is\ to be associated with the primary display is arranged to be produced by means of a computerized display/or standard lights sources located in the vicinity of the top or bottom of the housing of the apparatus and in such position that the display thereof may be reflected by a partially reflective inclined screen and interacting with the field of view of the primary display as seen by a viewer..
  5. 5. A display apparatus as claimed in claim 4, and wherein the second display which is to be associated with the primary display is arranged to be produced by means of a laptop, notebook or a dynamic image/object located in the vicinity of the base or top of the housing of the apparatus in such position that its display may be seen reflected by the partially reflective inclined screen to interact with the field of view of the primary display as seen by a viewer.
  6. 6. A display apparatus as claimed in claim 5, wherein the housing is in the form of a hollow closed container separated into upper and lower sections by means of the inclined partially reflective screen.
  7. 7. A display apparatus as claimed in any one of the preceding claims, wherein the housing includes an upper section including a rear wall, a top, side ails and a front wall, a lower section including a base, side walls formed by a continuation of the side walls of the upper section, a rar wall formed by a continuation of the rear wall ofb the upper section,and a front wall that is a continuation of the front wall of the upper section and of which a portion includes a transparent viewing screen.
  8. 8. A display apparatus as claimed in claim 6,wherein the partially reflective screen is inclined at an angle between 45 and 90 degrees to the horizontal.
  9. 9.A display apparatus construction and arranged to operate substantially as hereinbefore described with reference to Figure 2 or Figure 3 of the accompanying drawings
GB0908168A 2008-05-13 2009-05-13 A display apparatus producing two axially-separated, interacting images Withdrawn GB2459971A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB0808593.8A GB0808593D0 (en) 2008-05-13 2008-05-13 Display apparatus

Publications (2)

Publication Number Publication Date
GB0908168D0 GB0908168D0 (en) 2009-06-24
GB2459971A true GB2459971A (en) 2009-11-18

Family

ID=39571197

Family Applications (2)

Application Number Title Priority Date Filing Date
GBGB0808593.8A Ceased GB0808593D0 (en) 2008-05-13 2008-05-13 Display apparatus
GB0908168A Withdrawn GB2459971A (en) 2008-05-13 2009-05-13 A display apparatus producing two axially-separated, interacting images

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GBGB0808593.8A Ceased GB0808593D0 (en) 2008-05-13 2008-05-13 Display apparatus

Country Status (1)

Country Link
GB (2) GB0808593D0 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8395655B2 (en) 2010-08-15 2013-03-12 Hewlett-Packard Development Company, L.P. System and method for enabling collaboration in a video conferencing system
WO2013156613A1 (en) * 2012-04-19 2013-10-24 Basic Holdings A housing for an electronic display screen
EP2832407A1 (en) * 2013-08-01 2015-02-04 Bandai Co., Ltd. Image display device and program
JP2015090408A (en) * 2013-11-05 2015-05-11 株式会社バンダイ Video display device and program

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5440428A (en) * 1993-09-30 1995-08-08 Hughes Aircraft Company Automotive instrument 3-D virtual image display
EP0880722A2 (en) * 1996-10-22 1998-12-02 Uwe Maass Device for representing moving images in planes located one behind the other
JP2000066131A (en) * 1998-08-19 2000-03-03 Harness Syst Tech Res Ltd Display device
US20020126396A1 (en) * 1996-08-16 2002-09-12 Eugene Dolgoff Three-dimensional display system
JP2003237412A (en) * 2002-02-14 2003-08-27 Denso Corp Vehicular head-up display device
DE102005034096A1 (en) * 2005-07-21 2007-01-25 Volkswagen Ag Combination instrument for motor vehicle has image information shown in distorted manner depending upon distance between first display unit and virtual image of second display unit and distance between first display unit and viewer
WO2008030080A1 (en) * 2006-09-08 2008-03-13 Medialusion B.V. Device for displaying virtual three-dimensional objects

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5440428A (en) * 1993-09-30 1995-08-08 Hughes Aircraft Company Automotive instrument 3-D virtual image display
US20020126396A1 (en) * 1996-08-16 2002-09-12 Eugene Dolgoff Three-dimensional display system
EP0880722A2 (en) * 1996-10-22 1998-12-02 Uwe Maass Device for representing moving images in planes located one behind the other
JP2000066131A (en) * 1998-08-19 2000-03-03 Harness Syst Tech Res Ltd Display device
JP2003237412A (en) * 2002-02-14 2003-08-27 Denso Corp Vehicular head-up display device
DE102005034096A1 (en) * 2005-07-21 2007-01-25 Volkswagen Ag Combination instrument for motor vehicle has image information shown in distorted manner depending upon distance between first display unit and virtual image of second display unit and distance between first display unit and viewer
WO2008030080A1 (en) * 2006-09-08 2008-03-13 Medialusion B.V. Device for displaying virtual three-dimensional objects

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8395655B2 (en) 2010-08-15 2013-03-12 Hewlett-Packard Development Company, L.P. System and method for enabling collaboration in a video conferencing system
WO2013156613A1 (en) * 2012-04-19 2013-10-24 Basic Holdings A housing for an electronic display screen
EP2832407A1 (en) * 2013-08-01 2015-02-04 Bandai Co., Ltd. Image display device and program
US9256070B2 (en) 2013-08-01 2016-02-09 Bandai Co., Ltd. Image display device and program
US9804391B2 (en) 2013-08-01 2017-10-31 Bandai Co., Ltd. Image display device and program
US10422993B2 (en) 2013-08-01 2019-09-24 Bandai Co., Ltd. Image display device and program
US11340454B2 (en) 2013-08-01 2022-05-24 Bandai Co., Ltd. Image display device
JP2015090408A (en) * 2013-11-05 2015-05-11 株式会社バンダイ Video display device and program

Also Published As

Publication number Publication date
GB0908168D0 (en) 2009-06-24
GB0808593D0 (en) 2008-06-18

Similar Documents

Publication Publication Date Title
US8976323B2 (en) Switching dual layer display with independent layer content and a dynamic mask
US9103524B2 (en) Immersive display with minimized image artifacts
US6808268B2 (en) Projection system for aerial display of three-dimensional video images
WO2019039600A1 (en) Aerial image display device
US8857994B2 (en) Transparent display with dynamic mask
US10139721B1 (en) Apparatus for synthesizing spatially separated images
EP3111424B1 (en) A display interposing a physical object within a three-dimensional volumetric space
CN109036152A (en) A kind of optical system for realizing multi-screen seamless tiled display
GB2459971A (en) A display apparatus producing two axially-separated, interacting images
WO2013031819A1 (en) Image projection device
CN209118668U (en) A kind of optical system for realizing multi-screen seamless tiled display
WO2013072920A2 (en) An improved device for displaying reflected three-dimensional images(s) or video(s)
US20110273364A1 (en) Device for portable viewable reflective display system
JP2008003172A (en) Reflection-type three-dimentional display screen and reflection-type three-dimentional display system
US5993005A (en) Video wall
US20160203744A1 (en) Low profile simulated 3d display device
CA2815975A1 (en) Portable simulated 3d projection apparatus
WO2021115352A1 (en) Stereoscopic display screen
CA2873479A1 (en) Simulated 3d projection apparatus
CN112946910A (en) Instrument with naked eye 3D display effect
JP5330587B1 (en) Kaleidoscope and its objects that project composite images
US11719875B2 (en) Light source module
US11527181B2 (en) System of producing visual effects
JP7405478B1 (en) Display device and display system
KR102587054B1 (en) Non-powered hologram device

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)