WO2023066480A1 - Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene - Google Patents
Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene Download PDFInfo
- Publication number
- WO2023066480A1 WO2023066480A1 PCT/EP2021/079102 EP2021079102W WO2023066480A1 WO 2023066480 A1 WO2023066480 A1 WO 2023066480A1 EP 2021079102 W EP2021079102 W EP 2021079102W WO 2023066480 A1 WO2023066480 A1 WO 2023066480A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- placement
- video
- shelf
- screen
- display area
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012545 processing Methods 0.000 claims abstract description 34
- 230000003287 optical effect Effects 0.000 claims description 19
- 238000003909 pattern recognition Methods 0.000 claims description 4
- 230000003595 spectral effect Effects 0.000 claims description 3
- 230000003068 static effect Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 7
- 230000002123 temporal effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 230000011664 signaling Effects 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 230000003111 delayed effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000007794 irritation Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000007935 neutral effect Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0464—Positioning
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/04—Electronic labels
Definitions
- the invention relates to a method for placing playback content within the display area of a screen of a video shelf.
- ESLs Electronic Shelf Labels
- These physical ESLs are manually attached to a shelf rail that forms the front end of a shelf at positions corresponding to products placed on the shelf and display essentially static product and/or price information with their typically electrophoretic screens.
- a so-called video shelf rail is known from the international patent application with publication number WO 2019/091566 A1, in which a video screen, which forms the front shelf rail end, is used, video-based information (a video or a video clip), in particular for a product, and to embed virtual ESL in these video clips and to display them corresponding to the positions of the products.
- This virtual ESL is positioned manually using a remote control such as a tablet computer.
- the object of the invention is therefore to provide a method in which the disadvantages mentioned when using video shelf rails are overcome.
- the subject of the invention is therefore a method for placing playback content within the display area of a screen of a video shelf rail, a digital image of the screen and/or of a product presentation area extending along the screen being captured with the aid of a camera and
- a placement indicator and its position in the digital image being automatically recognized with the aid of an image processing device, the placement indicator indicating or delimiting the place of a product to be presented along the screen, and
- placement data are generated with the aid of the image processing device based on the recognized position of the placement indicator, the placement data defining the space for the display of the display content within the display area, and
- the video shelf displays the playback content according to the placement data within the display area of the screen.
- the measures according to the invention have the advantage that, for the first time, a automatic placement of playback content is enabled, entirely without manual intervention by a supermarket employee.
- the placement data obtained in this way can be used in different ways for automatic placement as well as for changing the location, in particular following a previous placement, of the playback content within the display area, which will be discussed below.
- the playback content can be dynamically changing content, such as a video or video clip, or essentially static content, such as product and/or price information typically presented by an electronic shelf label .
- the respective type of playback content is represented by playback data that is processed by screen electronics on the video shelf screen, so that the screen displays the respective playback content at a defined display area position within its display area.
- Individual playback content can be positioned within the display area at individual display area positions and visually overlap or cover one another.
- the overlapping of larger playback content with smaller playback content can give the viewer a picture-in-picture impression.
- a video can be presented on the one hand and the video can be overlapped by a virtual ESL in a part of the display area on the other.
- a video that evokes emotions can be shown for a product along the entire length of the display area and at a certain point, strictly speaking a section within the display area, i.e. within the video, sober product and/or price information can be shown with the help of the virtual ESL represent.
- the display area can also be divided along its length according to the different products along which it extends.
- n videos can be played side by side for n products, in which the respective virtual ESL belonging to the product is embedded.
- dynamic content can also be reproduced there.
- the product display area of a shelf is the area where products are presented to customers. These are usually shelves that are arranged side by side or one above the other in different configurations. The front edges of such shelves, which are oriented towards the customer, are delimited by the video shelf rails.
- the product presentation area can also be understood as an area in which, for example, products hanging next to one another and/or grouped on top of one another in various configurations are presented.
- the video shelf rails can also be positioned e.g. hanging below the hanging products or attached to a structure of the shelf, such as the rear end wall or side partitions or struts.
- the digital image is represented by image data that is generated by the camera when the camera captures video or still images of the respective scene in the field of view of the camera.
- This means that the digital image can be a digital still image (e.g. in JPG or GIF format, etc.) or a sequence of digital still images, as well as a digital video (e.g. in MP4 or MOV format, etc.).
- the placement indicator which is recognized fully automatically, can be of the most varied nature or also have the most varied characteristics, which is discussed in detail below.
- each of the video shelf rails has a video screen.
- the ESL system has a multitude of wireless base stations, also called access points, which each supply groups of video shelf rails with the dynamic as well as the static playback content that matches the products that are on the through the respective video shelf rail limited shelves are presented.
- the radio assignment works by selecting a suitable radio channel in the ISM band, which is used by the respective access point, and registering the relevant video shelf rail with the access point responsible for it.
- An essentially standardized radio protocol such as ZigBee® or also Bluetooth® or also a WI_AN network or a wired LAN network can be used for the radio communication.
- the access points are typically wired to a higher-level or central control device, such as a local server, on which a software application (e.g. shop management software) for managing and controlling the ESLs or for defining the visually perceptible Playback content of the virtual ESLs is executed, or a cloud-based software application, which controls the supply of the video shelf rails with the playback content and, if necessary, also covers other aspects of merchandise management.
- a software application e.g. shop management software
- shop management software for managing and controlling the ESLs or for defining the visually perceptible Playback content of the virtual ESLs
- a cloud-based software application which controls the supply of the video shelf rails with the playback content and, if necessary, also covers other aspects of merchandise management.
- the placement indicator and its position are initially recognized automatically using computerized image content and/or pattern recognition.
- Software is used that runs on a processor and is then optimized for the placement indicator to be identified, which may have a characteristic that is to be identified, in particular a previously known characteristic, in the digital image created by the camera to find.
- an optical signal in particular a light signal in the spectral range that is not visible to humans, is recognized as the placement indicator.
- This light signal makes it much easier to recognize the placement indicator because its intensity or its spectrum can be easily highlighted or distinguished from the background and is therefore easier to find in the digital image during a digitized search than is the case with non-luminous objects.
- the optical signal can also be located in the range of the spectrum that is not visible to humans, with the result that customers who are in the shop cannot see it any further and therefore these customers cannot see it through the optical signal either get irritated.
- the camera is naturally optimized for the wavelength to be processed or the spectral range of the light signal.
- the optical signal is particularly preferably formed by a signal that changes over time and/or space.
- this type of signal can make it easier to find in the digital image, because a change in the image content is often easier to recognize automatically than static image content.
- the optical signal can also be used to transport further information that can be recorded, for example, when the optical signal is found in the digital image. This additional information can, for example, relate to the product that should be found at the position of the optical signal or in its vicinity.
- a time-varying optical signal can be understood to mean, for example, a flashing light signal. This light signal can be emitted by a single light source, for example.
- a spatially variable optical signal can be understood, for example, as a possibly flashing light signal emitted by different light sources or positions, ie a combination light signal generated by different light sources.
- a spatially and temporally variable light signal can be understood, for example, as a temporally changing cloud of light points displayed on a screen
- the optical signal can be emitted by the screen.
- the screen can have a light-emitting diode or the like integrated, for example, on its housing or also in a frame enclosing the display area.
- the display area of the screen can also be used, for example, to emit a simple static light signal at a certain point, to emit a simple flashing light signal, or to display a pattern that can change over time and/or space. Such a pattern is particularly suitable for transporting the additional information through appropriate coding.
- the control of the light-emitting diode or the screen for the purpose of sending out the optical signal is carried out here by the electronics of the video shelf rail.
- the display area can be optically perceptibly segmented along its length and thus display the corresponding presentation segments along the length of the shelf. This can be recognized in the digital image of the display area by the image processing device and used to generate such placement data that, for example, the virtual ESLs are placed in the display area of the screen of the video shelf rail corresponding to the center of the respective presentation segment.
- the optical signal is emitted by a shelf divider located in the product presentation area.
- a shelf divider is an essentially plate-shaped object that is placed on the shelf and spatially separates two products or product groups that are separated by it to its left and to its right. This is accompanied by the effect that the playback content displayed with the aid of the video shelf rail can be played back undisturbed by the delivery of the optical signal.
- the signaling by the optical signal is spatially separated from the video shelf rail and therefore does not disturb the customer's perception of the playback content.
- the shelf separator is equipped with one or more light-emitting diodes on its front and/or upper housing side or in the intersection area between these two housing sides, which are controlled with the aid of electronics of the shelf separator accommodated in the housing.
- the front side of the case is the one that faces the area in front of the shelf and also essentially faces the video shelf rail.
- the upper side of the housing is that which faces away from the shelf on which the products in question are presented.
- the camera must be positioned in such a way that it can capture one or more LEDs on the shelf separator installed in the shelf.
- a product or a product group is recognized as the placement indicator, which is in located in the product presentation area.
- the advantage of this embodiment is that no additional light sources or the screen itself need to be used for signalling. This reduces the technical as well as investment-related outlay on the side of the video shelf rail and possibly also on the side of an optionally provided shelf divider or the like.
- the computerized image content and/or pattern recognition is based on the products or product groups that can be found on the shelf through the computerized image analysis in order to arrive at the placement data.
- the placement data is sent by the image processing device to the higher-level control device, with the control device placing the playback content according to the placement data within the display area of the screen of the video shelf rail, in particular that of which the digital image was captured, controls, in particular controls individually for a variety of such video shelf rails.
- the overriding control device can be the server, which is housed in the retailer's premises and which runs software which supplies the individual video shelf rails with playback data.
- This playback data represents the static and/or also dynamic playback content to be displayed with the respective screen for the entire display area of the screen.
- the higher-level control device can also be available as a cloud-based software solution that runs on a server or with is hosted in a data center with the help of a server farm and is available to the retailer for the stated purposes via the Internet.
- a background video can be played that fills the entire display area, and the virtual price labels belonging to the respective products can be displayed in the background video within the display area corresponding to or adjacent to those positions at which different products are placed next to each other on the shelf.
- the placement of the virtual price tags, which represent the display information to be positioned, within the display area is described here by the placement data and the placement data are used by the control device to place the price tag/price tags along the width of the display area.
- the higher-level control device transmits the playback data intended for the respective video shelf rail either as a data stream to the video shelf rail in order to obtain real-time playback there.
- the higher-level control device can also transmit the playback data as a data package to be transmitted once to the relevant video shelf rail, where this data package is stored and continuously (i.e. the playback content defined with it in a repetitive manner, e.g. as a locally stored video clip or video film) will be played back.
- the background video mentioned above can also be spatially segmented along the longitudinal extension of the display area of the screen of the video shelf rail, with each video segment forming an individual dynamic playback content for a specific product of the different products presented next to each other on the shelf.
- the placement of the individual video segments along the width of the display area is described here by the placement data, and the placement data is used by the controller to place the individual video sequences along the width of the display area.
- the respective width of the display of the individual video sequence can also be set automatically by the control device, taking into account the placement data, so that, for example, all of the video sequences displayed side by side video segments fills the entire width of the display area.
- the placement data are sent by the image processing device directly to the video shelf rail, from which the digital image of the screen or of a product presentation area extending along the screen was recorded, with the video shelf rail controls the placement of the playback content according to the placement data within the display area of the video shelf screen.
- the functionalities discussed according to the first embodiment of processing the placement data can be implemented, although these are now implemented directly by the electronics of the respective video shelf rails.
- the background video, possibly the video sequences, and also the correct number of virtual shelf labels are transmitted in digital form from the central control device to the respective video shelf rail.
- the background video as well as the video sequences can be transmitted from the control device to the video shelf rail, as mentioned above, as a continuous video stream or as a completed download.
- the transmission of the respective virtual shelf label will be implemented as a download.
- This does not have to be, but can also be the preferred transmission to the video shelf rail for virtual shelf labels with dynamic content.
- the second form of training in particular has the advantage that the task of placing the respective playback content is decentralized at the respective video shelf rail, i.e. no massive computing power to be provided in this regard has to be planned for the central control device and also the data traffic between the control device and the video shelf rails only on the provision / transmission of the respective playback content, possibly also limited to their initial placement.
- the video shelf rails by definition already have the ability to play videos, it is easy for the electronics installed there, and possibly also the software used there, to run powerful software that can be used to position both dynamic as well as static playback content can be accomplished.
- the decentralized available digital resources of the video shelf rails such as memory and computing power, are optimally utilized in order not only to accomplish pure playback, but also to carry out automated placement of the playback content to be played back. In the case of more extensive installations in large supermarkets, which can include several thousand video shelf rails, this massively relieves the higher-level central control device.
- the placement data describes a placement within the display area of the video shelf.
- the placement data can describe or represent a placement in the display area in at least one of the ways listed below, namely:
- - a single coordinate defining a position in the display area along a direction.
- This describes, for example, the already mentioned placement along the length of the display area, which runs parallel to the longitudinal extension of the shelf behind it.
- a coordinate is thus described along the different products or product groups that can be found along the length of a shelf.
- Specifying placement in this way assumes that all playback content will be placed, for example, at the bottom of the display area or at a fixed distance from it, or categorized into different groups (dynamic/static or video/label) at a different distance from the bottom Display area are placed.
- - a pair of coordinates to define a position of a point in the display area. The use of a pair of coordinates allows for complete flexibility in placement in relation to the edges of the display area. A playback content can now be placed anywhere within the display area.
- a playback content can only be scaled along this line, i.e. one-dimensionally, or the second dimension (orthogonal to this line) can also be scaled proportionally.
- the display content can also be proportionally scaled for display within this area in at least one dimension, preferably in two orthogonal dimensions, to fit within the specified area.
- the placement data can be generated at any time and can also be used for placement continuously after it has been generated. However, it has proven to be particularly advantageous if the placement data is only used for the placement of the playback information under the condition that:
- a predefined threshold value in particular a predefined fixed threshold value or a threshold value that changes dynamically over time
- a temporal threshold value in particular a temporal threshold value defined by the typical length of time a customer spends in front of the video shelf rail.
- This aspect of the invention takes into account the fact that an immediate implementation of generated placement data - as mentioned directly by the video shelf rail or by the central control device - is often not desired at all, because this leads to a, albeit often only locally small, However, this can lead to high-frequency, space changes in the playback content, which can lead to irritation for the viewer of the video shelf rail. It is therefore advantageous that a re-placement of the playback content specified by the placement data is subjected to an evaluation in which it is checked whether a re-placement should take place at all.
- the dimensions of the product or product group along the video shelf rail can play a role in the assessment of whether it is a local difference that should or should not be taken into account. It can thus be ensured, for example, that minimal local differences that would be expected within the scope of the camera's detection, for example due to changing lighting conditions or shadows and the like, can be blanked out (ie ignored). In contrast, larger local differences, such as those that can occur when products that are already on the shelf are repositioned or when products are removed from the shelf or as a result of products being restocked on the shelf, are taken into account.
- the period of time can be included in the assessment of whether there is a difference to be considered or not.
- This can be, for example, a permanently set threshold value of a few seconds up to a few minutes, with the determined local change being taken into account only after this temporal threshold value has elapsed.
- the temporal threshold value preferably relates to the usual length of time a customer spends in front of a shelf. With that ensures that the local change in placement is only implemented when it can be assumed that a customer has left the relevant shelf or the relevant space in front of the shelf. This measure can be of great advantage, for example, when several identical products are placed next to each other and the virtual label is positioned centrally to these products. If a product is removed from the edge area of this group of products and a new placement of the virtual label in relation to the remaining products is displayed using the placement data, this new placement can be delayed until it can be assumed that the customer in question left the shelf.
- the camera and the image processing device can be designed separately from one another. This can be advantageous, for example, when cameras that are as inexpensive as possible are used and, for example, forward the digital images obtained with them in groups to a central image processing device for this group of cameras, where the positioning data are generated.
- the camera and the image processing device are preferably integrated in one device, in particular the image processing device is integrated in the camera, and the positioning data is transmitted directly to the video shelf rail and/or to a higher-level control device by radio, with the higher-level Control device a variety, in particular the entirety, controls the video shelf rails in a shop with individual playback content.
- this measure requires special camera training, it also creates an infrastructure that is much easier to install, because the number of components to be installed is reduced by the image processing devices that would otherwise be required and their connection to the relevant camera.
- the method using one camera is used for a plurality of playback contents that are intended for playback on the one screen. It is thus possible to place different playback content per screen with the aid of a single camera. Furthermore, it is advantageous if the method is applied using one camera for a plurality of playback contents that are intended for playback on a plurality of screens, in particular installed on shelves arranged next to one another or one above the other. This means that with a single camera it is also possible to place different playback content for a plurality of screens arranged vertically and horizontally adjacent to one another, ie the screens are grouped into one camera. A camera can also be used to control the placement of the playback content for an entire shelf, possibly also for a number of shelves, as long as the relevant shelf is within the detection range of the camera.
- the screens located in the detection area can be uniquely identified to the camera or the image processing device, e.g. by means of a visualized code, so that the assignment of playback content to the screens and the placement data intended for them remain unambiguous.
- the video shelf rail can display a symbol (especially for a short time). , in order to calibrate the system or the respective camera.
- the camera stores the position and extent of the display area of the respective screen in order to include this information in the processing of the digital image by the image processing device.
- the symbol displayed for this purpose can be, for example, a line drawn along the outer edge of the display area, i.e. the extent of the available display area.
- a barcode or a QR code or an alphanumeric display with unique Identification cards take place, which are also recorded during initialization or calibration, so that they are then available during operation.
- the electronics can be constructed discretely or by means of integrated electronics or a combination of both.
- Microcomputers, microcontrollers, application-specific integrated circuits (ASICs), possibly in combination with analog or digital electronic peripheral components, can also be used.
- ASICs application-specific integrated circuits
- Many of the functionalities of the devices mentioned are implemented - possibly in conjunction with hardware components - with the help of software that runs on a processor in the electronics.
- Devices designed for radio communication usually have an antenna configuration for sending and receiving radio signals as part of a transceiver module.
- the electronic devices can also have an internal electrical power supply, which can be implemented either with a replaceable or chargeable battery.
- the devices can also be wired, supplied either by an external power pack or by means of "Power over LAN" or by radio signals transmitting power.
- FIG. 1 shows a section of an ESL system with a shelf on which video shelf rails are attached, which show virtual ESLs that have been placed initially;
- Figure 2 shows a camera used in the ESL system
- 3 shows an automatic change in the placement of the virtual ESLs according to a first exemplary embodiment of the invention
- 4 shows a further automatic change in placement caused by a product removal
- FIG. 1 shows an electronic shelf label system 1, called system 1 for short below, in which video shelf rails 2 are used.
- a system 1 can be based only on video shelf rails 2 or also a mixed infrastructure of video shelf rails 2, with the help of which dynamic playback content as well as virtual electronic shelf labels (virtual ESLs for short) can be displayed, and physical electronic shelf labels (physical ESLs), with the help of which usually only static playback content can be displayed.
- virtual ESLs virtual ESLs for short
- physical ESLs physical electronic shelf labels
- the system 1 has a central server 4 which stores a planogram of the business premises.
- the planogram is a data structure that represents or represents the positions of products and associated virtual (as well as physical) ESLs, i.e. logically linked to the respective product, as well as their three-dimensional position in the shop, specifically on the shelves and the shelves installed there. depicts.
- Each ESL is identifiable by a unique ESL code.
- the positions of the video shelf rails are also noted in the planogram, with each video shelf rail also being clearly identifiable with the aid of a unique video shelf rail code.
- the Server 4 also provides the static and dynamic playback content for display with the Video Shelf Rails 2 and the physical ESLs, only the Video Shelf Rails 2 being discussed in the present case.
- Playback data WD which represent the respective playback content, are sent from the server 4 with the aid of a radio base station 5, called base station 5 for short, to the respective video shelf rail 2 transmitted and stored there.
- the video shelf rails 2 in turn each have a video shelf rail radio communication level which is familiar per se and which is not shown in detail and with the aid of which they are integrated into the radio network of the bastion 5 .
- the server 4 knows the assignment of the video shelf rails 2 to the base stations 5 and can therefore specifically address the individual video shelf rails 2 in order to transmit the playback content that matches the products 6A - 6D that are on the respective shelf 7 of the shelf 3 are presented, in order to avoid overloading the figures with reference numbers for identifying the products, not all products 6A - 6D are marked with reference numbers, but the different products 6A - 6 D are clearly identifiable by their special shape.
- the server 4 also transmits initial placement data PDI, which the video shelf rails 2 use to place or position the playback content within the display area 8 of their (video) screen 9 .
- the display area 8 is delimited with a broken line, which is intended to indicate that the screen 9 is surrounded by a slim frame (not specially marked). Of course, the frame can also be very slim. The frame can also be dispensed with entirely.
- a background video which shows a pan through a landscape scene
- the video shelf rails 2 as dynamic playback content, which playback this background video fills the display area 8 .
- Two groups of products are presented on the two shelves 7, namely the products 6A and 6B on the upper shelf 7 and the products 6C and 6D on the upper shelf 7, side by side.
- the upper shelf 7 is for products used in hiking, such as hiking socks 6B packaged in oblong, more flat packages, and hiking shoes 6A, packaged in more cubic packages.
- Products 6C and 6D presented on lower shelf 7 also differ - at least for the purposes of this discussion - in the shape of their packaging.
- virtual ESLs 11A - HD which virtual ESLs 11A - 11D represent the respective product and/or price information for the product in question 6A - 6D, from the server 4 together with initial placement data as static playback content PDI have been transmitted to the respective video shelf 2, after which each of the video shelf 2 displays the respective virtual ESLs 11A-11D according to the position within the display area 8 indicated by the initial placement data PDI.
- the virtual ESLs 11A - 11D are each initially positioned on the left or on the right edge of the display area 8 .
- the respective virtual ESL 11A - 11D which only fills a fraction of the display area, is displayed in front of the background video.
- the respective background video is therefore covered in sections by the relevant ESL 11A-11D.
- the system 1 also has a camera 12 which is attached to a structure 13 which is not specified further.
- This structure 13 can be, for example, a wall, a ceiling, a column or another shelf etc. in the business premises, from where the shelf 3 to be captured by the camera 12 can be viewed unhindered.
- the camera 12 has conventional optics 14 provided for digital image acquisition and camera electronics 14A coupled thereto, with which at least first software for implementing an image acquisition stage 15 is executed, with which a digital image DA is created from the shelf 3 with all the items located there, ie the products 6A - 6D and the screens 9 of the video shelf rails 2 .
- Second software for the implementation of an image processing device 16 is also processed with the camera electronics 14A, with the aid of which a placement indicator and its position are recognized in the digital image.
- the second software is consequently optimized for pattern recognition in the digital image.
- the camera also has a camera-radio communication level that is known per se and has not been illustrated. With their help, the camera 12 is integrated into the radio network of the base station 5 and can communicate both with the server 4 and with the video shelf rails 2 .
- the different products 6A - 6D are directly recognized on the shelf 3 by the image recognition device 16 and by determination on the basis of the different packaging or their shapes or dimensions or their labels (or through a combined evaluation of these aspects). That area which they occupy in groups along the respective screen 2 or the display area 8, a presentation area PBA, PBB, PBC, PBD of the respective group of products 6A - 6D is identified.
- the center of the respective presentation area PBA, PBB, PBC, PBD is determined and this absolute position along the longitudinal extent of the display area 8 (measured e.g. from the left edge of the display area) using individual placement data PDA for the first virtual ESL 11A, PDB generated for the second virtual ESL 11B, PDC for the third virtual ESL 11C and PDD for the fourth virtual ESL HD.
- the respective virtual ESL 11A-11D is also automatically recorded and the relevant ESL 11A-11D is thus unambiguously identified.
- This unique identification can be done either by evaluating the product and/or price information of the respective virtual ESLs 11A - 11D or by recognizing a unique identification code that is displayed using the respective ESLs 11A - 11D or by determining the position of the respective ESLs 11A - 11D take place within the display area 8 of the respective screen 8 .
- the video shelf rail 2 in question knows at least one of the three parameters required for the unique identification of the virtual ESL 11A to 11D in question, because the video shelf rail 2 stores the product and/or price information for the virtual ESL 11A - 11D in question and /or stores the identification code of the respective ESL 11A - 11D and/or in any case also stores the position of the respective ESL 11A - 11D at which it overlaps the video.
- the placement data PDA - PDD generated for the respective virtual ESL 11 A - HD are then transferred from the camera 12, which is also integrated into the radio network of the base station 5, to the relevant video shelf rail 2 and there for the placement of the respective virtual ESLs 11A - 11D are used.
- the position of the virtual ESLs 11A-11D is thus changed by the controlling effect of the placement data PDA-PDD in such a way that each virtual ESL 11A-11D is now placed centrally for the respective presentation area PBA-PBD.
- the camera 12 can be configured in such a way that, in addition to the placement data PDA-PDD, it can also output the data that represent the digital image DA as such, i.e. the raw data or already pre-processed raw data from the image acquisition.
- FIG. 3 The new positioning of the virtual ESLs 11A - 11D is shown in FIG. 3, the arrows FA - FD representing the shift in the position of the respective virtual ESLs 11A - 11D along the length of the respective video Show shelf rail 2 or its display area 8 of the screen 9 in comparison to the respective starting position, as shown in FIG.
- the four background videos are planned or displayed, for example per shelf 7, with a 50%/50% split along the display area. If the image processing device now recognizes that on the upper shelf 7 the first products 6A only occupy 40% and the second products 6B 60% of the longitudinal extent of the screen 9 or its display area 8, corresponding first and second placement data PDA, PDB are generated, which of the top video shelf 2 define a video display width of 40% for the background video associated with the first product 6A and a video display range of 60% for the background video associated with the second product 6B.
- the two background videos are scaled accordingly and subsequently Presentation area PBA and PBB displayed appropriately. It can also be provided that a section of the respective overall video image of the relevant background video that matches the respective product presentation area PBA or PBB is displayed there in order to avoid unnatural distortions that can arise from non-proportional scaling of the width and height of the video image.
- the image processing device 16 programs the lower video shelf rail 2 accordingly to display the third background video with 70% of the length of the display area 8 corresponding to the third presentation area PBC and the fourth background video with 30% of the length of the display area 8 corresponding to the fourth presentation area PBD to display.
- the positioning of the products 6A - 6D can be indicated by so-called shelf dividers 17A to 17D, which are shown in FIG Figure 1, where the products 11A - HD themselves formed the placement indicators, in this case now the Form placement indicators that are automatically recognized by the image processing device 16.
- the shelf separators 17A-17D can be identified in the digital image DA by the image processing device 16 because of their special shape, which makes them clearly distinguishable from the products.
- the shelf separators preferably have shelf separator electronics (not shown), which are also designed for radio communication in the radio network of the base station 5 . In the course of such radio communication, identification data for the clear identification of the product 6A-6D placed adjacent to it are transmitted to the respective shelf divider 17A-17D.
- the electronics of the shelf separators 17A - 17D also have an LED 18A - 18D visible outside on the front or top of the housing or a light guide which is coupled to the LED 18A - 18D installed inside the housing.
- the shelf divider electronics of the respective shelf divider 17A - 17D emit a variable (modulated or flashing) light signal with which the unique identification data are also given as information content.
- the individual shelf dividers 17A-17D are recognized by the image processing device 16 as a placement indicator and also their position.
- the shelf dividers 17A-17D are to be placed to the right of the respective product 6A-6D, as shown in FIG.
- the first product presentation area PBA extends between the adjacent shelf dividers 17A and 17B.
- the third product display area PBC extends between the adjacent shelf dividers 17C and 17D.
- the second product presentation area PBB extends to the left of the second shelf divider 17B up to the end of the upper shelf 7 or also the upper video shelf rail 2 .
- the fourth product presentation area PBD extends to the left of the fourth shelf divider 17D to the end of the lower shelf 7 or also the lower video shelf rail 2 .
- a final shelf separator (not shown) can also be provided on the left side of each shelf 7, which emits a neutral light signal and simply used to delimit the presentation areas PBB and PBD.
- the image processing device 16 can generate the placement data for the virtual ESLs 11A to HD and transmit this to the video shelf rail 2 by radio, where the new placement of the virtual ESLs 11A - 11D is carried out analogously to FIG.
- actively emitting light-emitting placement indicators are easier for the image processor 16 to detect than is the case when the products themselves are used as the placement indicator. This reduces the error rate and significantly accelerates the recognition and identification process. Therefore, the use of other objects that actively emit light can also be used as placement indicators. They only have to be suitable for indicating or delimiting the space of a product to be displayed along the screen.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Display Racks (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2021/079102 WO2023066480A1 (de) | 2021-10-20 | 2021-10-20 | Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene |
AU2021469674A AU2021469674A1 (en) | 2021-10-20 | 2021-10-20 | Method for placing a piece of playback content within the display area of a screen of a video shelving rail |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/EP2021/079102 WO2023066480A1 (de) | 2021-10-20 | 2021-10-20 | Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023066480A1 true WO2023066480A1 (de) | 2023-04-27 |
Family
ID=78332797
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2021/079102 WO2023066480A1 (de) | 2021-10-20 | 2021-10-20 | Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU2021469674A1 (de) |
WO (1) | WO2023066480A1 (de) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019091566A1 (en) | 2017-11-10 | 2019-05-16 | Ses-Imagotag Gmbh | Electronic shelf label system with positioned virtual shelf labels and a method of positioning said virtual shelf labels |
US10636391B2 (en) * | 2016-12-09 | 2020-04-28 | Toshiba Tec Kabushiki Kaisha | Electronic label system including control device for controlling electronic labels |
-
2021
- 2021-10-20 WO PCT/EP2021/079102 patent/WO2023066480A1/de active Application Filing
- 2021-10-20 AU AU2021469674A patent/AU2021469674A1/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10636391B2 (en) * | 2016-12-09 | 2020-04-28 | Toshiba Tec Kabushiki Kaisha | Electronic label system including control device for controlling electronic labels |
WO2019091566A1 (en) | 2017-11-10 | 2019-05-16 | Ses-Imagotag Gmbh | Electronic shelf label system with positioned virtual shelf labels and a method of positioning said virtual shelf labels |
Also Published As
Publication number | Publication date |
---|---|
AU2021469674A1 (en) | 2024-05-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
DE112016003708B4 (de) | Beleuchtungsverwaltungssystem | |
EP3178043B1 (de) | Regalbeleuchtungssystem und verfahren zum auffinden von waren und verwalten von preisinformationen | |
EP2783550B1 (de) | Konfiguration von betriebsgeräten für leuchtmittel | |
EP2045510A2 (de) | Bewegungsgesteuerte Leuchte und Leuchtenanordnung | |
WO2014198628A1 (de) | Kältegerät mit einer tür | |
WO2021001432A1 (de) | Lagerregal zur lagerung mindestens eines lagergutträgers und verfahren zum erfassen eines lagerbestands eines lagerregals | |
DE202015009162U1 (de) | Erkennung wichtiger Haltestellen für die Gruppierung von Fahrten | |
DE102018102619A1 (de) | Beleuchtungsvorrichtung und Bestromungsverfahren | |
EP2923533B1 (de) | Konfiguration von betriebsgeräten für leuchtmittel | |
DE102012224147B4 (de) | System und Verfahren zum Auswählen von Teilnehmern eines Beleuchtungssystems | |
WO2008107150A1 (de) | Überwachungssystem, insbesondere zur analyse des füllstands von regalen | |
WO2023066480A1 (de) | Verfahren zum platzieren eines wiedergabe-inhalts innerhalb des anzeigebereichs eines bildschirms einer video-regalschiene | |
WO2014198632A1 (de) | Kältegerät mit einem kameramodul | |
Graf et al. | Event-Regie | |
EP3502569B1 (de) | Verfahren und vorrichtung zur optimierung eines backvorgangs | |
DE102019125987A1 (de) | Verfahren, system und vorrichtung zur navigationsunterstützung | |
WO2019115318A1 (de) | Verfahren zur visualisierung von sensordaten und/oder messdaten | |
DE102015216062A1 (de) | Sensorvorrichtung zur Erfassung eines manuellen Eingriffs in einen Vorratsbehälter | |
DE202021004412U1 (de) | System zum logischen Verknüpfen einer elektronischen Anzeigeeinheit mit einem Produkt | |
WO2023061599A1 (de) | Verfahren zum logischen verknüpfen einer elektronischen anzeigeeinheit mit einem produkt | |
AT17251U1 (de) | Intelligente Steuerung der Lichtcharakteristik | |
WO2023110099A1 (de) | Verfahren zum bestimmen der position von einrichtungselementen, insbesondere von elektronischen etiketten | |
EP2752761B1 (de) | Warenpräsentationssystem | |
DE202023107560U1 (de) | System zur Erstellung einer digitalen Abbildung eines Verkaufsbereiches | |
EP4377234A1 (de) | Verfahren zur bestimmung einer abmessung eines produkts in einer produktpräsentationsvorrichtung |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21798020 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: AU2021469674 Country of ref document: AU |
|
ENP | Entry into the national phase |
Ref document number: 2021469674 Country of ref document: AU Date of ref document: 20211020 Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2021798020 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021798020 Country of ref document: EP Effective date: 20240521 |