WO2018080405A1

WO2018080405A1 - Interactive display system and device

Info

Publication number: WO2018080405A1
Application number: PCT/TH2017/000076
Authority: WO
Inventors: Sasis SUWONPAKPRAK
Original assignee: Suwonpakprak Sasis
Priority date: 2016-10-31
Filing date: 2017-10-25
Publication date: 2018-05-03

Abstract

An interactive display system and device according to this invention provides an improved connection flexibility by marker detection. The marker according to this invention can be easily utilized by users through application or website on the devices. Interactive display system generally comprising a device, a server, and an interactive display device, or at least one of them together to create an interactive display system and device which are flexible and applicable in various business settings, adaptable to space and usage objective, cheaper, and extendable to more devices, not limited to device or interactive display device, such as printed objects and even ordinary objects.

Description

Title of the invention

INTERACTIVE DISPLAY SYSTEM AND DEVICE

Field of the invention

Computer and peripheral engineering, in particular to the digital transmission device, interactive display system and device.

Background of the invention

Augmented reality is the cutting-edge technology to augment data on real objects or places by referring environmental image, sound or GPS locating system, etc. It also creates additional data onto existing object in image, sound, or other formats which adds more dimensions to the data or can interact with users. It initiates additional experiences or perceptions from reality.

Components of augmented reality technology includes: a marker, a marking or image which is designated to compare with database, camera, or detecting sensor to analyze markers. The system will calculate pose estimation of marking with camera, display unit to display database on screen and computing unit for analyzing data to create 3D image or object.

Interactive display system is user-interactive system by displaying data or multimedia in proper format which conforms to action or command of users, for example, interactive system of smartphones or tablets. Interactive display system has been developed continuously and become popular. Many businesses have applied screen interactive for various usages such as home decoration application, which allow user to see real decoration before making decision to buy such furniture.

Moreover, another type of interactive display system which is used extensively is the interactive table. It is a touch screen that connects with users by reading marker or connecting with mobile device to display data, games, or etc. to respond demand of users. This invention has been disclosed in the following:

Invention patent No. 11/363,750 name "Compact interactive tabletop with projection- vision" has disclosed details of interactive table which interact with users by projecting image from projector that make it can be installed wherever. This invention detects markers on the object which are saved in its database then displays pairing data by projecting image to interact with users.

This invention has objective to change normal surface to interactable surface. It can be applied in games playing or for educational purpose. Invention patent No. US2010889778 A name "Interactive display" has disclosed details about the system which consists of screen and display projector. Its screen has retro-reflective layer and diffuse layer. The diffuse layer diffuses the light from projector, and retro-reflective layer detects images and submits to process in computing unit. When processing complete, the projector will respond by projecting image according to action of the users below and interacting with user's command. In the other hand, interactive display system is the procession of user's command by reading range of light or shadow.

Because the invention mentioned above is processed and displayed by projector so it contains many flaws, for example, the precision of reception from user's command is not high due to light reflection then the display is delayed. In over lighted area, the inconsistence reflection causes the error in detecting of light range to process and/or display so it becomes less popular in outdoor activities like marketing campaign.

In invention patent No. US2008110032A named 'Interaction between objects and a virtual environment display', it has disclosed the detection of objects and object locations when that object is on the screen surface. That invention is the identification of object to display well- designed information such as images and texts by light perception especially infrared read from installed microchip in each mobile devices. It has infrared camera or sensor under the screen to identify.

When the user needs connection to upload data into interactive display system, it can be done by putting mobile device with proper microchip on touchscreen and the system will display selected data around that device to increase user's experiences in data management such as mobile data transfer, meetings, or marketing.

Such interactive display system has many disadvantages; it requires mobile devices with specific microchip within its database only. It lacks flexibility for practical use. In terms of marketing, this interactive display system may not attract customers because the installation of microchip into mobile device costs both money and time. Moreover, the customers may not use because they do not want to modify their own devices.

Summary of the invention

To solve the problems as stated above, the interactive display system according to this invention has improved the flexibility of the connection. Changing from data reception of marker in former inventions to the connection by installed microchip mobile devices or devices. Markers in this invention can be easily used through an application or website to make it convenient to connect with interactive display system. The proper interactive display system comprising a device, server, or interactive display device, or at least one of their parts together on at least one position.. For interactive display device, it shall be connected to a server or a receiver to transfer data. Such equipment shall comprise at least one image receiving device to detect marker that appears.

To make the interactive display system and device which is flexible, applicable to various types of businesses, adaptable to space and objectives, cheaper, and extendable to connect with more devices, not only device or interactive display device, like printed objects or ordinary objects. Application of augmented reality has widen the connectivity border of object and interactive display devices.

Brief description of drawings

Figure 1 illustrates one embodiment of an interactive display system according to this invention;

Figure 2 illustrates one process of an interactive display system according to this invention;

Figure 3 illustrates one way an image receiving device can read the marker;

Figure 4 illustrates one embodiment of the connection between a device and an interactive display device;

Figure 5 illustrates a user interface on an interactive display device; Figure 6 illustrates one embodiment of the interactive display device; Figure 7 illustrates one embodiment of the interactive display device; Figure 8 illustrates one embodiment of the interactive display device;

Figure 9 illustrates one embodiment of the interactive display device;

Figure 10 illustrates one embodiment of the interactive display device;

Figure 11 illustrates one embodiment of the interactive display device;

Figure 12 illustrates one embodiment of the interactive display device;

Figure 13 illustrates one procedure for installing an image receiving device;

Figure 14 illustrates one information transfer process of an interactive display system;

Figure 15 illustrates one information transfer process of an interactive display system.

Detailed description of the invention

An interactive display system according to this invention as shown in the diagram in Figure 1 comprises a device (1), a server (2) or an interactive display device (3) or at least one of their parts together or in combinations on at least one position.

The device (1 ) which comprises a transmission with the server (2) by a wired or wireless connection or their combinations. The device (1) connects with server (2) to access the interactive display device (3) wherein that connection is carried out by properly pairing with database in the server (2) or the interactive display device (3) or in combinations. Besides this, there is no limitation of connectivity of device (1), which is capable of connecting with interactive display device (3) directly without the connection via server (2).

For pairing with the server (2), in the proper requirement, the device (1) may comprise an application (1 1) with at least one program installed to transfer operations or tasks between the device (1) and server (2) or interactive display device 3 or combinatorially. Furthermore, other device (1) may be paired to connect with the server via a website (12).

The device (1) according to this invention can be one or more mobile devices, optionally selecting from smartphone, laptop computer, desktop computer, mini PC, tablet PC or in combination.

The server (2) is a device or operating system or program or their combinations which operates or provides services to network system or devices (1). A suitable server (2) may be a stand-alone server or a cloud server or their combinations for the objectives to service, manage, or store systematic data for correct and precise searching and access.

A preferable server (2) may be connected through wire or wirelessly or in combination with the device (1) and/or interactive display device (3) to manage connection between device (1) and interactive display device (3). In any case, the server (2) be installed with or without at least one program for the objective of processing or transmitting and receiving tasks from device (1) and/or interactive display device (3).

Additionally, the server (2) may also comprise a management service, a storage, or a database server. The interactive display device (3) may comprise a wired or wireless connection to transfer data with the device (1), or may connect with the device (1) directly without the server (2) connection. The preferable interactive display device (3) may comprise a screen (31), a computing unit (32), an image receiving device (33), or at least one of their parts in combinations, and at least one additional peripheral. The screen (31 ) connects to the computing unit (32) by a wired or wireless connection.

The screen (31) may comprise: an input module which receives input data from user or peripherals (34) or other information computing system or in combination, and an output module which exports signal or data (7) to user or peripherals (34) to display by the character of such peripherals, or export to other computing system, or in combinations. The preferable screen according to this invention may be a touchscreen which provides as both the input and output modules in the format of IR frame or capacitive touchscreen, or other formats according to the objectives of this invention in order to limit the size of input and output modules but not the type of screen (31) in other embodiment with separated input and output modules. The computing unit (32) may be connected to the screen (31), the image receiving device (33), the peripherals (34), the server (2), the device (1), or their combinations by wired or wireless connection wherein the computing unit (32) may comprise at least one installed program to process input data from server (2), or device (1), or input module of screen (31), or camera (33), or peripherals (34), or their combination to display or control operations of devices on interactive display device (3) correctly and also export data to device (1) and server (2).

Figure 3 illustrates how the image receiving device (33) reads the markers (5) wherein the image receiving device (33), in one embodiment, may exhibit the characteristics of a common camera which comprises a light detection sensor and lens to detect marker (5) that appears on the device (1). The image receiving device (33) shall be wirely or wirelessly connected to the computing unit (32) to transmit data.

The interactive display system according to this invention is the improvement of connection flexibility by receiving marker (5) data instead of connecting by the installed microchip on the device (1).

Marker (5) according to this invention may be easily utilized by the user on device (1) via installed application (11) or website (12) or in combination. The marker (5) can be selected from augmented reality or barcode or QR code or their combination.

The marker (5) according to this invention, by no means, is limited to the embodiments as described in this invention, but can include various formats and configurations such as on other printed media or objects, and name card.

Figure 2 illustrates one diagram of an interactive display system comprising a marker caller (41) for calling the marker (5) to appear. The marker (5) may provide a specific character for each device to identify its users correctly.

The marker calling (41) may be done by opening the installed application (1 1) on the device (1) or on website (12) or in combination, then putting the device on the position (42) to enable the interactive display device (3) to read a value from the marker (5) wherein the suitable position of marker (5) is under coverage area of the image receiving device (33).

A pairing (43) between device and interactive display device (3) via medium server (2) or not shall occur when the image receiving device (33) reads a value of marker (5) and compares with the database in the server (2) or interactive display device (3) to identify ID of that marker (5).

Moreover, a pairing (43) as illustrated in Figure 4 shows the connection between the device (1) and the interactive display device (3) by searching the marker (5) on the interactive display device (3) or device (1) and inputting a URL on interactive display device (3) to identify ID of that marker (5).

According to Figure 5, a user interface (UI) on the interactive display device (3) is shown by screen (31 ) with a referral frame (6) that appears to specify position of device ( 1 ) on the screen (31). When the device (1) is put in proper position, user interface will appear with selected information around it.

As for a data transmission (44) after complete pairing (43), the interactive display system shall enable user to transfer data or information (7) between device (1) or interactive display device (3) or in combination whether via server (2) or not. The displayed information (7) is the result of computation, management, or data encryption which is properly selected, such information (7) such as user information, personal contact, photos, voice data, notes, news while not limit information (7) rights under coverage of this invention. The proper interactive display system may allow user to set the display information (7) on the interactive display device (3). For peripherals (34) which are the devices which connect to interactive display device

(3) to transmit action with computing unit (32) to export additional outputs such as speaker, light, keyboard, mouse, printer, scanner, power supply, modem, or altogether without limitation to other possible peripherals under the objectives of this invention.

The first embodiment in Figure 6 shows an interactive display device (3) which set the screen (31) input and output modules, separately. The input module surface is a touchscreen and output module is a LED displaying screen. Both modules have the transmission procedure to create consistency and computing unit (32) as an information processing unit or computer separated from the screen (31) by wired or wireless connection with screen (31).

The second embodiment in Figure 7 shows an interactive display device (3) by which the image receiving module (33) includes entirely with the screen wherein the screen includes input and output modules with inclusive processing unit.

The third embodiment according to Figure 8 shows an interactive display device wherein the computing unit is the microcomputer or other small information processer with integrated screen (31) or separated screen (31) between input and output modules via wired or wireless connection. The interactive display device (3) mentioned previously has the intention for making the structure (9) smaller, thinner, or with wider space, internally.

The fourth embodiment in Figure 9 illustrates the interactive display device (3) which comprise a tablet computer with an input screen (31) and computing unit (32). With tablet computer, the intention is for smaller structure or larger design space.

The fifth embodiment according to Figure 10 demonstrates an interactive display device (3) which embodies a tablet computer with a reflector for light refraction to detect marker (5) on device to image receiving device (33) in said tablet computer.

The sixth embodiment in Figure 12 illustrates an interactive display device which comprises a vertical interactive display component (3) and a horizontal interactive component (3) to enhance the interaction or display area. The interactive display device (3) here embodies a tablet computer with integrated screen (31 ) or separated screen (31 ) between input and output modules or either one of them. It brings together with the reflector (8) for light refraction to receive marker (5) on the device (1) to the image receiving device (33) in the tablet computer or the image receiving device (33) attached to the screen (31).

A preferable interactive display device (3) may comprisse an additional structure (9) with at least one arch or angle to support or contain the components of interactive display device (3) having a table-like structure and screen part on the top.

Figure 13 illustrates the installation of the image receiving device (33) by which a preferable interactive display device comprises at least one stand (331). The stand may be a long pole with arch or angle or either, and is stretched to the top of the edge of structure or side of screen (31) without being hidden or unclear from user's views during uses. A part of the stand (331) shall be grouped together with the image receiving device (33) by an adhering method to receive the marker (5). A preferable stand (331) should be able to fold, stretch, shrink, or bend for optimizing point of view to properly read or for clearer value of marker (5).

Figure 14 illustrates the transmission of information (7) of an interactive display device (3). It has detected and identified the device (1). The interactive display system shall display properly screened, selected, or sorted information (7) on the screen (31) in the position around the device (1). For the information (7) transmitting between the device (1) and other device (1) or device (1) and interactive display device (3), it can be transmitted with or without a server (2). When the users want to export information (7) from device (1), the interactive display system responds by dragging information (7) out of the screen on the device (1) then sending information (7) via wired or wireless network as internet transmission to the interactive display device with or without the server (2). That information (7) shall then appear on the screen (31) of interactive display device (3) near the direction that the user dragged the information (7) out of the device (1).

A suitable interactive display system shall record that information (7) into the memory interactive display device (3) to enable user's visibility to information on the screen (31) or ability to transfer information with other device (1).

The input of information (7) to device (1) can be done by dragging information (7) from the screen (31) of the interactive display device (3) into the area of device (1), then the computing unit (32) shall send that information (7) via wired or wireless network to the suitable device (1) and so that information (7) shall appear on the application (11 ) installed on the device (1). The information transmission can be done with or without the server (2).

Information (7) transmission of said interactive display system is not limited to any other transmission methods under objectives of this invention, such as information transmission by touching, light command, sound command instead of dragging or their combinations.

Additionally, the information (7) transmission of interactive display system in the format which supports multiple devices (1) according to Figure 15 that shows the information (7) transmission of an interactive display device shall be done according to above disclosure with additional personalization from different profile or user data of each of the devices. Aside from information (7) transmitting from reading the marker (5) on the device (1), the preferable interactive display system according to this invention shall be carried out by reading the marker (5) on other objects or printed media such as name card, specific shape objects or their combinations. Especially, when the interactive display system is reading the marker (5) or shape and pairing that marker (5) with information (7) that is saved in the server (2) or interactive display device (3) or in combination, it shall display that information (7) on the screen (31) at the position near that marker (5) or shape and the user can send information (7) with device (1) by similar method as mentioned above.

For the security purpose of information (7) saved in the interactive display device (3), proper interactive display system shall have deletion or encryption or either of saved information in the interactive display device (3) when user has logged out or disconnected from device (1) and interactive display system.

Besides from the transmission or display of information (7), an interactive display system may exhibit additional features in response to the demand of users. The additional features are: personalization, which is a presentation of related information (7) by processing from computing unit (32) or server (2) referred to profile or user data that differentiates each person; matching presentation, which is a presentation of information (7) that interactive display system predicts to match with users by processing from computing unit (32) or server (2); searching by interacting with user to search for desired data, sorting/filtering by sorting or filtering information (7) and displaying as the list of user desires; location checking, which interactive display system shall check the location by global positioning system to choose display information or screen specific information for user in nearby location or check the location for check-in.

Any improvements, adjustments, or adaptations according to this invention may be understood clearly and to be practiced by those with related skills of arts under the scope and intention of this invention as further provided in the attached claims thereof.

Claims

An interactive display system and device comprising a device (1), a server (2), or an interactive display device (3) or at least one of them together on at least one position wherein:

said server (2) is a machine or an operating system or a program or their combinations which services a network or the device (1);

- said interactive display device (3) having a wired or wireless connection with the server (2) or the device (1) to transmit data to each other and wherein the interactive display device (3) comprising a screen (31) to display an information (7), a computing unit (32), an image receiving device (33) or at least one of them together on at least one position wherein the computing unit (32) connects to the screen (31) and the image receiving device (33) via a wired or wireless connection; and

- the image receiving device (33) comprises a light detection sensor and a lens to detect a marker

(5) appearing on the device (1) or a printed media or a specifically-shaped object for pairing (43) between said device (1) or printed media or specific shape objects with said interactive display device (3)

The interactive display system and device according to claim 1 wherein the device (3) comprises at least one stand (331) in a shape of a long pole with an arch or an angle and is stretched up from the edge of a structure (9) or at the side of the screen (31) and wherein one part of the stand (331) is connectable with the camera (33).

The interactive display system and device according to claim 1 wherein the interactive display device (3) comprises at least one additional peripheral connectable to the computing unit (32) via a wired or wireless connection.

The interactive display system and device according to claim 1 wherein the device (1) is a mobile device selected from a smartphone, a desktop computer, a laptop computer, a tablet computer, or their combinations.

The interactive display system and device according to either of claims 1 or 4 wherein the device (1) comprises an application (11) installed with at least one program for transmitting tasks between said device (1) and the server (2) or the interactive display device (3) or their combinations.

6. The interactive display system and device according to claim 1 wherein a marker (5) in this invention can be utilized by calling through an application (11) installed on the device (1) or a website (12) accessible on the device (1) or their combinations.

7. The interactive display system and device according to either of claims 1 or 6 wherein the marker (5) can be selected from an augmented reality or a barcode or a QR code or their combinations.

8. The interactive display system and device according to claim 7 wherein the marker (5) is an augmented reality technology.

9. The interactive display system and device according to claim 1 wherein the server (2) comprises at least one program installed for processing, transmitting operations from the device (1) or the interactive display device (3) or both (1, 3).

10. The interactive display system and device according to claim 1 wherein the screen (31) comprises an input module, an output module, or both modules together.

11. The interactive display system and device according to claim 10 wherein the screen (31) has a touchscreen as both the input and output modules.

12. The interactive display system and device according to claim 11 wherein the touchscreen can be selected from an infrared touchscreen or a capacitive touchscreen.

13. The interactive display system and device according to claim 3 wherein the peripherals are: a speaker, a light, a keyboard, a mouse, a printer, a scanner, a power supply, a modem or their combinations.

14. The interactive display system and device according to claim 1 wherein the interactive display device (3) has the screen (31) with separate input and output modules.

15. The interactive display system and device according to claim 14 wherein the input module is a touchscreen surface.

16. The interactive display system and device according to claim 14 wherein the output module is a LED screen.

17. The interactive display system and device according to claim 1 wherein the interactive display device (3) having the computing unit (32) as an information processer or computer separated from the screen (31) and wherein said computing unit (32) connects to the screen (31) via a wired or wireless connection.

18. The interactive display system and device according to claim 1 wherein the interactive display device (3) comprising the image receiving device (33) integrated with the screen (31)

19. The interactive display system and device according to claim 18 wherein the integrated screen (31) has inclusive output and input modules with the computing unit (32).

20. The interactive display system and device according to claim 1 wherein the interactive display device (3) has the computing unit (32) as a microcomputer or an information processor.

21. The interactive display system and device according to claim 1 wherein an interactive display device (3) is a tablet computer.

22. The interactive display system and device according to claim 1 wherein an interactive display device (3) is arranged with a vertical interactive display component (3) with a horizontal display component (3).

23. The interactive display system and device according to either of claim 21 or 22 wherein the interactive display device (3) has an additional reflector (8)

24. The interactive display system and device according to any of the preceding claims wherein the interactive display device (3) has an additional structure (9) with an arch or angle or at least one of them together for supporting or containing the components of interactive display device (3) thereof.