KR20040075312A - Smart digital modules for operational polymorphism and smart digital wall surfaces combining the same - Google Patents

Abstract

PURPOSE: An intelligent digital wall is provided to show congregate reactions by coupling the computing resources of many intelligent digital modules effectively. CONSTITUTION: The intelligent digital wall contains: two or more intelligent digital modules sensing the state of the surroundings or the changes of the state, then indicating the corresponded reaction separately; and a global coordinator(10) connected with two or more intelligent digital modules by radio communications respectively and coupling two or more intelligent digital modules to control the congregate action of two or more intelligent digital modules.

Description

SMART DIGITAL MODULES FOR OPERATIONAL POLYMORPHISM AND SMART DIGITAL WALL SURFACES COMBINING THE SAME}

The present invention relates to an intelligent architectural surface (SAS), and more specifically, to an intelligent digital module modularized by combining sensing, recognition, and response functions, and various interactions with a user using such intelligent digital modules. An intelligent digital wall surface, which is a surface configured for use as a mediating interface.

Walls in our living environment have a variety of functions, not just physical elements that partition the space. Among them, with the development of information technology and display technology, attempts have been made to utilize the walls of buildings as a kind of screen for projection of images or projections. This tendency means that we are entering the process of realizing an intelligent home or an ubiquitous home as an environment that can be interacted with inhabitants as seen in movies.

One such prior art is "The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces" by Pinhanez of Watson Research, IBM (Proc. Of Ubiquitous Computing 2001 (Ubicomp'01). 2001. Atlanta, Georgia). Here, it consists of an LCD projector and a rotatable mirror, the LCD projector is characterized in that it receives the location information of the occupants and displays the information required by the user in a desired position. However, this technology lacks a mechanism for detecting the user's position in real time and still has the inherent limitations of the beam-projector, which obscures the screen if other objects exist between the projector and the projection surface.

Another prior art is "Hello. Wall Beyond Ambient Displays" (Video Track and Adjunct Proceedings of the 5th Intern. Conference on Ubiquitous Computing (UBICOMP'03), Seattle, Washington, USA, et al. Oct. 12-15, 20), where a gossip wall (GossipWall), which is a kind of reactive surface with different reaction patterns according to the distance from the user, is composed of a plurality of cells that constitute the wall based on the sensor. Each cell detects people passing by using LED assemblies and RFID transmitters and displays different light patterns accordingly. In addition, if you have a mobile display called "ViewPort" and approach the wall easily, the viewport can read the ID of each cell and view the display information unique to a specific cell through the viewport. However, in this technology, since the types and amounts of information that can be represented by LEDs are extremely limited, it is difficult to provide truly specialized information to users, and there is a problem of using a separate mobile device as an interface for interaction. There is this.

In addition, the prior art that utilizes the wall of the building as a kind of screen for projection of the image or projection has a problem that it is difficult to interact with the user by performing a function mainly limited to the output of audiovisual data.

Accordingly, an object of the present invention is to solve the above-described problems, and the detection, recognition, and reaction functions are combined using various reactors including a variety of sensors, a computer for information processing, and a display with sufficient visual representation of information. It is to provide a intelligent digital module that can be modularized and combined with the intelligent digital module that can interact with the user.

1 is a functional block diagram of an intelligent digital module according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a sensor configuration included in a perception / reaction unit of the intelligent digital module illustrated in FIG. 1.

FIG. 3 is a diagram illustrating a reactor configuration included in the perception / reaction part of the intelligent digital module illustrated in FIG. 1.

4 is a front configuration diagram of the intelligent digital module.

5 is a rear configuration diagram of the intelligent digital module.

6 is a functional block diagram of an intelligent digital wall according to an embodiment of the present invention.

FIG. 7 is a block diagram illustrating an intelligent digital wall shown in FIG. 6, (a) is an intelligent digital wall configured in a stacked manner, and (b) is an intelligent digital wall configured in a frame insertion type.

FIG. 8 is a diagram illustrating a software structure for controlling the intelligent digital wall shown in FIG. 6.

FIG. 9 is a diagram illustrating an example of a software configuration for implementing a response of media playback based on voice recognition in the software structure for controlling the intelligent digital wall shown in FIG. 8.

FIG. 10 is a diagram schematically illustrating a process of performing scanning for measuring a location of a user on an intelligent digital wall according to an exemplary embodiment of the present invention.

FIG. 11 is a flowchart of a scanning process illustrated in FIG. 10.

Intelligent digital module according to a feature of the present invention to achieve the above object,

Intelligent digital module for polymorphic function conversion

A perception unit for sensing a state or change of state of the surroundings; A reaction unit displaying various types of information in response to a state or a state change detected by the perception unit; A display unit for displaying visual information; And a computing unit processing the signal output from the perceptual unit to display corresponding response information through the reaction unit or the display unit, wherein the computing unit is configured to respond to the position and situation of the user detected by the perceptual unit. And varying the form of the various information displayed via the display.

Here, the perception unit includes a variety of sensors for detecting a state or a change in the surroundings, wherein the various sensors include an environmental sensor for measuring a surrounding state and an action sensor for detecting a change in activity of the user. do.

Intelligent digital wall according to another feature of the invention,

As an intelligent digital wall for polymorphic transformation,

Two or more intelligent digital modules capable of independently detecting a state or a change in state and displaying a corresponding response independently; And a global coordinator connected to the two or more intelligent digital modules through wireless communication, respectively, and combining the two or more intelligent digital modules to control the collective operation of the two or more intelligent digital modules.

Herein, the global coordinator may be configured to generate an adaptive response corresponding to a series of sensed events based on a user's request or recognition of contextual information sensed by at least one intelligent digital module of the two or more intelligent digital modules. It is characterized by the implementation through the intelligent digital module.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention. Like parts are designated by like reference numerals throughout the specification.

Hereinafter, an intelligent digital module according to an embodiment of the present invention will be described in detail.

1 is a functional block diagram of the intelligent digital module 100 according to an embodiment of the present invention, Figure 3 is a front configuration diagram of the intelligent digital module 100, Figure 4 is a rear configuration diagram of the intelligent digital module 100 to be.

As shown in FIG. 1, the intelligent digital module 100 according to the embodiment of the present invention includes a perception / reaction unit 110, a display unit 120, and a computing unit 130.

The perception / reaction unit 110 perceives an external state or state change through various sensors, and also indicates a response of the intelligent digital module 100 to the outside. Here, when the various sensors included in the perception / reaction unit 110 refer to FIG. 2, the temperature / humidity sensor 111-1 measuring the temperature / humidity greatly, and the illumination sensor 112-1 measuring the illuminance And an environmental sensor for measuring a state of an external environment, a camera 113-1 for capturing an external image, a microphone 114-1 for receiving an external voice, and a touch sensor for sensing a touch input from the outside. 1) It is roughly classified into an action sensor that detects a change in an external environment, such as an ultrasonic sensor 116-1 which detects a location of users through ultrasonic waves. At this time, the outputs of the respective sensors 111-1, 112-1, 113-1, 114-1, 115-1, and 116-1 are amplifiers 111-2, 112-2, 113-2, and 114, respectively. It is delivered to the computing unit 130 through -2, 115-2, 116-2.

Meanwhile, various reactors included in the perception / reaction unit 110 may include a speaker 117-1, a light emitting diode (LED) 118-1, and the like. These various reactors 117-1 and 118-1 operate by receiving reaction signals from the computing unit 130 through amplifiers 117-2 and 118-2, respectively.

In addition, the perception / reaction unit 110 may further include various sensors for capturing external events required by the intelligent digital module 100 and various reactors for indicating the response of the events captured by the sensors.

On the other hand, the display unit 120 receives a signal for expressing the visual information from the computing unit 130 and displays a corresponding screen, a general display device, for example, a liquid crystal display (LCD), a plasma display panel (PDP), etc. Although may be used, it will be described in the embodiment of the present invention assumes that the LCD is more advantageous in terms of cost or power. The size of such LCD should be about 15 inches or more monitor size, especially if the touch screen function is added.

When the display unit 120 refers to FIG. 4, the display unit 120 is disposed on the front surface of the intelligent digital module 100 so that users can easily view visual information from the outside.

In addition, the perception / reaction unit 110 is disposed on a long strip-shaped PCB substrate adjacent to one side of the side surface of the display unit 120. At this time, the speaker 117-1 of the perception / reaction unit 110 is disposed on the upper rear side of the display unit 120, referring to FIG. 5, and in the case of a stereo system, two speakers 117-1 are provided. Respectively disposed on two upper corners.

Meanwhile, the computing unit 130 receives and processes signals output from the perception / reaction unit 110 to recognize various external states or changes in external states, and recognizes the response signals according to each state. And outputs the appropriate visual information through the display 120.

The computing unit 130 includes a central processing unit (CPU) 131, a display control unit 132, a memory 133, a hard disk 134, an input / output unit 135, and the like. The CPU 131 is a control entity that controls each component in the computing unit 130. For example, the CPU 131 may be a general-purpose CPU having a speed of about 400 MHz or more, and the memory 133 may be used to operate the CPU 131. As a temporary storage device for storing necessary data and data necessary for various processes, the storage device may be 64 MB or more of synchronous dynamic random access memory (SDRAM) or double data rate (DDR) RAM, and the hard disk 134 may be the computing unit 130. It stores data used in the data or data input and output from the perception / detection unit 110, for example, may be a compact flash card or a storage device of 20GB capacity or more. In addition, the display controller 132 controls the visual information displayed on the display unit 120 under the control of the CPU 131. The specifications of the CPU 131, the memory 133, the hard disk 134, and the like may vary depending on the processing target or operation purpose of the computing unit 130 of the intelligent digital module 100.

The computing unit 130 detects an input from various sensors of the perception / reaction unit 110 to detect a state of a surrounding environment or a change in the state, and thus displays the display unit 120 or the perception / reaction unit 110. And the corresponding reactions through the various reactors. For example, the computing unit 130 recognizes a user's voice input through the microphone 114-1 of the perception / reaction unit 110 and displays a corresponding response in the display unit 120 or the perception / reaction unit 110. Through reactors.

On the other hand, the display unit 120 is a user's position detected by various sensors of the perception / reaction unit 110, in particular, the camera 113-1, the ultrasonic sensor 116-1, etc. under the control of the CPU 131. And the size of visual information to be displayed according to the moving state. For example, even when the same information screen is displayed, the entire information screen is displayed when the user is near the intelligent digital module 100, but some information screens are displayed when the user is far from the intelligent digital module 100. FIG. Controlled to. In addition, when the user passes the front of the display unit 120 of the intelligent digital module 100 is detected by the sensors of the perception / response unit 110 and recognized by the computing unit 130, the display unit ( 120 is controlled to move the displayed screen together in the direction in which the user passes.

On the other hand, while minimizing the expected mutual collisions such as electromagnetic interference and heat generation, while minimizing the performance of the various components included in the intelligent digital module 100, the electronic components assembled to the minimum size 4 and 5, an interface for effectively supplying the power required for the operation of the intelligent digital module 100 is also installed.

As described above, a single intelligent digital module is combined to form an intelligent digital wall, which is one of the intelligent digital surfaces, and will be described in detail with reference to the following drawings.

6 is a functional block diagram of an intelligent digital wall surface according to an embodiment of the present invention, Figure 7 is a block diagram of the intelligent digital wall surface. Here, Figure 7 (a) is an intelligent digital wall surface configured in a stacked type, (b) shows an intelligent digital wall surface configured in a frame insertion type.

As shown in FIG. 6, the intelligent digital wall surface according to the embodiment of the present invention is composed of a plurality of intelligent digital modules 100, 200,..., N, and is controlled by a global coordinator 10.

As described with reference to FIGS. 1 to 5, the plurality of intelligent digital modules 100, 200,..., N are wireless LAN units capable of exchanging information with each other through a wireless LAN and exchanging information with the global coordinator 10. 100-40, 200-40, ..., N-40). For example, the intelligent digital module 100 recognizes an external state or state change through various sensors, and also recognizes / reacts 100-10 indicating signals corresponding to the outside and signals for visual information representation. Receives and processes signals output from the display unit 100-20 and the perception / reaction unit 100-10 for receiving a corresponding screen and recognizes various external states or changes in external states, and reacts according to each state. Information exchange through wireless communication between the local coordinator (100-30) and the local coordinator (100-30) and the global coordinator (10) for outputting a signal to the perception / response unit (100-10) or the display unit (100-20) Wireless LAN unit 100-40 to enable this. Here, the local coordinator 100-30 includes a wireless LAN communication function through the wireless LAN unit 100-40 in the computing unit 130 in the intelligent digital module 100 described with reference to FIGS. 1 to 5. .

On the other hand, the global coordinator 10 is connected to the local coordinator (100-30, 200-30, ..., N-30) of the plurality of intelligent digital modules (100, 200, ..., N) is controlled through wireless communication . That is, the global coordinator 10 is a collective decision module for a plurality of intelligent digital modules 100, 200,..., N, and local interspersed with a plurality of intelligent digital modules 100, 200,. Coordinators (100-30, 200-30,…, N-30) are controlled to perform collective operations such as sensing, speech recognition, speech synthesis, and multimedia playback for each intelligent digital module (100, 200,…, N). To control. Therefore, the local coordinators 100-30, 200-30, ..., N-30 in each intelligent digital module 100, 200, ..., N have real-time perception / reaction units 100-10, 200-10,... , N-10) collects sensor data, for example, microphone and camera inputs, temperature / humidity sensor values, etc., and receives a user's voice command. The wireless LAN unit 100-40, 200-40,…, N-40) transmits the corresponding data to the global coordinator 10, and receives a command transmitted from the global coordinator 10, the perception / response unit (100-10, 200-10, ..., N-10) or display The corresponding information is displayed by collectively using the units 100-20, 200-20, ..., N-20.

The global coordinator 10 may exist in one of a plurality of intelligent digital modules 100, 200,..., N forming one intelligent digital wall, but in the present embodiment, a plurality of intelligent digital modules 100, It is assumed that it is installed in a computer separate from 200, ..., N) to assume its function.

Meanwhile, referring to FIG. 7, a configuration form of the intelligent digital wall surface according to the embodiment of the present invention is shown.

Referring to (a) of FIG. 7, the intelligent digital modules 100, 200,..., N of each unit are stacked to form an intelligent digital wall according to an embodiment of the present invention. ), The intelligent digital modules 100, 200, ..., N for each unit are configured to be inserted into a metal frame as indicated by the cross section of the frame, thereby forming an intelligent digital wall according to an embodiment of the present invention.

Referring to FIGS. 7A and 7B, a plurality of intelligent digital modules 100, 200,..., N are combined in a lattice to form one intelligent digital wall surface. In this process, the display units 100-20, 200-20,..., N-20 attached to the front of each intelligent digital module 100, 200,..., N are in the range as possible as in the case of the conventional multivision. It is designed to secure continuity in consideration of the possibility of change of one screen size. In addition, in the case of FIG. 7B, a separate lattice metal frame for structurally supporting an intelligent digital wall constructed of a plurality of intelligent digital modules 100, 200,..., N is provided. It combines a number of intelligent digital modules (100, 200, ..., N). At this time, in consideration of the heat dissipation from the back of the intelligent digital wall to maintain a constant distance between the original architectural wall and the intelligent digital wall integrated with the metal frame. In addition, a wiring is formed through the metal frame to supply sufficient power for all the intelligent digital modules 100, 200,..., N constituting the intelligent digital wall.

FIG. 8 is a diagram illustrating a software structure for controlling the intelligent digital wall shown in FIG. 6.

As shown in Fig. 8, the software structure of the intelligent digital wall surface is composed of the hardware including the sensors and the reactor at the bottom level, the operating system on the top, the sensor value processing, the networking, Unique API (Application Programming Interface) for supporting multimedia, database, etc., and various software components for supporting multi-modality, for example, modules for voice recognition and gesture recognition. A local coordinator or global coordinator or the like related to the control of the system is established. Finally, various applications based on this infrastructure are developed and serviced.

FIG. 9 is a diagram illustrating an example of software for implementing a response of media playback in a software structure for controlling the intelligent digital wall shown in FIG. 8.

As shown in FIG. 9, each of the intelligent digital modules 100, 200,..., N is equipped with voice recognition software, sensor interface software, media playback software, and module management software, respectively. In order to collectively control (100, 200, ..., N), central management software for controlling each module management software is mounted in one intelligent digital module (100, 200, ..., N).

Here, the voice recognition software is mounted in the computing unit 130 to receive voice recognition data through the microphone 114-1 of the perception / reaction unit 100-10, 200-10, ..., N-10. In addition, the sensor interface software is mounted on the computing unit 130 to receive sensor data through other sensors and deliver the sensor data to the module management software. In addition, the media playback software is mounted in the computing unit 130, and receives the media data transmitted from the module management software and corresponds to the perception / response units 100-10, 200-10, ..., N-10 or the display unit ( 100-20, 200-20,…, N-20).

The module management software is installed in the local coordinator (100-30, 200-30,…, N-30), and receives voice recognition data or sensor data through the voice recognition software and sensor interface, and delivers them to the central management software. The system then receives the resulting data from the central management software and sends it to the media playback software.

On the other hand, the central management software is mounted on the global coordinator 10, after receiving the voice recognition data, sensor data, etc. from the module management software mounted on each intelligent digital modules (100, 200, ..., N) and processes them Coordinate each module management software to ensure that a response such as collective media playback is implemented.

Hereinafter, the function of the intelligent digital wall surface according to the embodiment of the present invention will be described in detail.

Intelligent digital wall according to an embodiment of the present invention is a number of intelligent digital modules that can interact with the user, which is different from the output device for simply reproducing the screen and sound that can be resized like a conventional simple multi-screen ( Various functions can be performed based on the combination of 100, 200, ..., N).

First, one of the various functions is the function as an intelligent multimedia player. Text, images, video and sound and various combinations thereof may be played through one or more intelligent digital modules 100, 200, ..., N. At this time, the multimedia file is stored in one or a plurality of intelligent digital modules (100, 200, ..., N) or may be streamed or downloaded through the Internet, etc., such multimedia content may be sent to the perception / response unit ( User's location and identity information selected by the user's voice command through 100-10, 200-10,…, N-10) and captured through the captured image using sensor input or camera for location recognition Based on the display unit (100-20, 200-20, ..., N-20) for playback, the size and position of the screen as well as its contents are determined. For example, if the user speaks the name of a favorite singer in front of the intelligent digital wall, the global coordinator 10 first operates a face recognition program to activate the perception / reaction unit (100-10, 200-10,…, N-10). After the user's identity is recognized through the user, the user's favorite songs are selected among the songs of the singer spoken by the user in the database, and the perception / reaction unit (100-10, 200-10,…, N -10) is selected. Based on the user's location and the distance from the intelligent digital wall, the screen of the music video is output to the front of the user through the display unit 100-20, 200-20,…, N-20, and one or more sizes are displayed. By adapting and playing back through the intelligent digital modules (100, 200, ..., N) of the to adapt to the contextual factors associated with the user.

Another example is the function of the intelligent information browser. The intelligent digital wall can deliver various information through one or more intelligent digital modules 100, 200, ..., N in a user-specific manner. At this time, the information file is stored in one or a plurality of intelligent digital modules (100, 200, ..., N), respectively, or can be streamed or downloaded through the Internet, etc. The content and nature of such information is the voice of the user The size and position of the screen for reading are determined based on the user's identity identified through the command or the image captured by the camera, and the sensor's position detected by the sensor. For example, when the user stands in front of the intelligent digital wall and requests the information of the day by voice, the global coordinator 10 first operates a face recognition program to activate the perception / response unit 100-10, 200-10,…, N-. 10) After identifying the user's identity recognized through the list of information that the user normally enjoys reading in the database, or the information that is already stored or downloaded from the Internet or an external server through a number of intelligent digital modules (100, 200, ..., N). This may include weather, stock price information, time and personal schedules, TV programs, shopping, or travel-related information. If the user selects one of the multiple pieces of information displayed on the intelligent digital wall like this, the user's location and intelligent digital wall identified through the perception / reaction unit (100-10, 200-10,…, N -10) Situational factors related to the user by outputting the detail screen for the specific information item selected on the basis of the distance of the user, and adjusting the size of the selected information item over one or more intelligent digital modules 100, 200, ..., N Adapt to the fields.

As described above, in order to interact with the intelligent digital wall according to the embodiment of the present invention, the global coordinator 10 should be capable of speech recognition. Such a voice recognition function may require training to omit a training process that is sensitive to specific people's voice in order to operate for a plurality of users, or vice versa, to more accurately recognize only a voice command of a limited user.

In more detail, each of the intelligent digital modules 100, 200, ..., N has its own voice recognition software that can detect a voice signal. Therefore, when a user issues a voice command at a specific position in front of an intelligent digital wall composed of a plurality of intelligent digital modules 100, 200,..., N, a plurality of surrounding intelligent digital modules 100, 200,. The voice recognition software mounted in the microphone 114-1 and the computing unit 130 provided in the perceptual / reaction unit 100-10, 200-10, ..., N-10 of N) recognizes each module. Each recognized word or phrase is converted into a letter and transmitted to the global coordinator 10. The global coordinator 10, which has collected all the recognition result information transmitted from the plurality of intelligent digital modules 100, 200, ..., N, which were involved in speech recognition, identifies the highest frequency among the delivered recognition words or phrases. Based on this, the user's voice command is performed. In this process, it is assumed that a plurality of intelligent digital modules 100, 200, ..., N have voice recognition software each having a speech recognition recognition rate of 70%, for example, 10 intelligent digital modules 100, 200. , ..., N) is involved in the speech recognition, seven of them will recognize the user's voice command properly, the performance is improved compared to the case where one intelligent digital module is responsible for speech recognition. For example, even if only three of the ten recognize the same word or phrase, and all the others are different, the system can work properly.

In addition, the intelligent digital wall can be used to operate one or a plurality of intelligent digital modules (100, 200, ..., N) via a wireless keyboard and a mouse, if necessary. It is possible to mount an infrared sensor in the perception / reaction part (N) of the N) (100-10, 200-10, ..., N-10). Therefore, the mouse and keyboard signals for wireless operation may be received by an infrared sensor mounted on one or more intelligent digital modules 100, 200,..., N, and may be processed by the global coordinator 10. As such, the remote controller, which is a remote control device for controlling the intelligent digital module, can select each intelligent digital module in the same manner as changing a channel of a television by inputting a unique number, and selecting a selected intelligent digital module or an intelligent digital wall front schedule. An infrared transmitter (Infrared Transmitter) that can send a control signal at a distance is provided. In this way, the short and long term of the infrared signal generated from the infrared transmitting device is detected using an infrared sensor mounted on the perception / reaction unit (100-10, 200-10, ..., N-10) of each intelligent digital module, The computing unit 130 converts the digital signal into a global coordinator 10 and activates a specific application service through a kind of matching table in which the global coordinator 10 converts it into a specific instruction in software. Using one remote control system, commands for controlling the intelligent digital module can be operated in a short distance.

In addition, another interface for controlling each of the intelligent digital modules 100, 200, ..., N is a touch screen method. Graphical user directly output to specific intelligent digital module if user needs after attaching LCD display (100-20, 200-20,…, N-20) to each intelligent digital module (100, 200,…, N) Graphic User Interface Elements, that is, pull-down menus, buttons, slide bars, icons, and the like can be directly manipulated to perform necessary functions. The touch screen function can be used to control single or multiple intelligent digital modules 100, 200, ..., N, and the process of developing application services for operation of the intelligent digital wall for activation of the touch screen function. Add graphical user interface components in.

In addition, one of the interfaces for remotely controlling or monitoring the intelligent digital wall composed of each intelligent digital module or a plurality of intelligent digital modules 100, 200, ..., N is a web-based interface. Install a web server on one of the intelligent digital modules (100, 200,…, N) and access the URL of this web server using a web browser installed on various terminals at a long distance, and then control and monitor the intelligent digital module. You will access a Hyper Text Markup Language (HTML) document that contains a graphical interface for the client. These HTML documents will contain various graphical interface components, such as ActiveX and JAVA BEANS, that can exchange data in real time with the server. These interface components include, for example, buttons, pull-down menus, lists, text boxes, slide bars, check boxes, video or image frames, and the like, and the user can manipulate them on the web to remotely identify specific or multiple intelligent digital modules. Fields 100, 200,..., N may be remotely controlled or data may be received from these modules in real time in various formats such as text, image, video, and sound. This web-based remote interface is a multi-level hierarchical visual system for selectively controlling or monitoring an intelligent digital wall composed of a set of intelligent digital modules or a set thereof, or an intelligent digital space composed of a set of such walls as needed. The user selects identification icons step by step and remotely exchanges the necessary information in real time through pull-down menus, buttons, text boxes, and graphs. The hierarchical configuration on the user interface for designating one or more intelligent digital modules 100, 200, ..., N corresponding to a target node may, for example, identify a particular building, its interior spaces, each space. It can be obtained by visualizing a tree structure of icons constituting the wall surfaces and icons representing the intelligent digital modules 100, 200, ..., N constituting each wall surface. Actually data exchange between the client-side web interface and the intelligent digital module or server platform on which the global coordinator 10 is installed to control the operation of the intelligent digital wall consisting of a number of these modules 100, 200, ..., N Is based on two-way socket communication based on IP address. Through this web interface, the user remotely checks the image of a child left at home detected by a camera attached to a specific intelligent digital module through a video frame on a web browser and reversely manipulates the web interface, for example, a specific intelligent digital. The children in front of the module can send text messages remotely in the office, which can be received by intelligent digital modules and converted directly to voice via TTS (Text To Speech) software.

In addition, another interface for remotely controlling or monitoring each intelligent digital module or an intelligent digital wall composed of a plurality of intelligent digital modules 100, 200,..., N is a PDA based mobile interface. Remote exchange of information by manipulating a graphical interface for the client for the control and monitoring of specific or multiple intelligent digital modules 100, 200, ..., N simply produced using a stylus pen on the LCD display screen of the PDA Done. PDAs include a variety of graphical interface components that enable real-time data exchange with the server side installed in certain intelligent digital modules. These interface components include, for example, buttons, pull-down menus, lists, text boxes, slide bars, check boxes, video or image frames, and the like, and the user can manipulate them on a PDA to remotely identify specific or multiple intelligent digital modules. Fields 100, 200,..., N may be remotely controlled or data may be received from these modules in real time in various formats such as text, image, video, and sound. Since the PDA-based remote interface is similar to the above-described web interface, it will be easily understood by those skilled in the art when referring to the above-described web interface and PDA-based interface, even if the detailed description is omitted.

On the other hand, the intelligent digital wall is disposed on a plurality of intelligent digital modules (100, 200, ..., N), respectively, and based on the intelligent digital wall surface, the ultrasonic sensor 116-1 which is a position recognition sensor arranged at regular intervals. By periodically scanning a certain distance on the front surface of the intelligent digital wall, the presence of people or objects in these areas and the distance from the wall can be measured and used in various applications.

In addition, the intelligent digital wall surface allows the user to access one or more intelligent digital modules 100, 200, ..., N through the Internet to perform necessary functions or to monitor information of interest.

In addition, the camera 113-1 attached to each intelligent digital module acquires a face image of the user in front of the intelligent digital module, and compares it with a plurality of face images registered in a database through face recognition software installed in the corresponding intelligent digital module. After identifying the identity of the user based on the matching, it can provide an application service considering the personal preference. For example, if the user's face recognition is used to find out who the user is, information such as music that the user enjoys, frequently read weather, stock price, shopping, and music video can be transmitted through the intelligent digital wall. With respect to the configuration of the face recognition interface, parameters such as the distance between the camera 113-1 and the user necessary to limit the error of the face recognition within a certain range and the angle of the user's face turned left and right relative to the front side may be optimized. Face recognition algorithm. In other words, we use a face recognition program for database registration and retrieval of three-dimensional face images based on image-based rendering techniques using multiple cameras that constitute one intelligent digital wall. That is, three-dimensional face shape data is registered in the database using images acquired from two or more cameras close to the user, and a face is obtained from two different angles obtained by two or more cameras, respectively, when a specific user stands in front of an intelligent digital wall. The recognition rate can be greatly increased by performing a search on a database based on the images to confirm the user's identity.

In addition, one intelligent digital wall surface can obtain a user's image in real time from a variety of angles through a kind of camera grid formed by a set of cameras 113-1 mounted on each intelligent digital module constituting the intelligent digital wall. Using the special camera grid, the user's face image is taken from various angles, and the best image is selected by a kind of voting mechanism between the intelligent digital modules 100, 200, ..., N participating therein. It can be used for face recognition as well as other application services.

FIG. 10 is a view schematically illustrating a process of performing scanning for measuring a location of a user on an intelligent digital wall according to an embodiment of the present invention, and FIG. 11 is a flowchart of performing the process.

As shown in Figs. 10 and 11, the global coordinator 10 is responsible for the local coordinator (100-30, 200-30, ..., N-300) of each of the intelligent digital modules (100, 200, ..., N) Scanning is performed by controlling the perception / reaction units 100-10, 200-10, ..., N-10.

First, the number of intelligent digital modules 100, 200,..., N performing scanning is determined, and a variable m representing the number is initialized to 0 to start a scanning loop (S100).

Next, after oscillating the ultrasonic sensor 116-1 in the m + 1th intelligent digital module (100, 200, ..., N) (S110) in consideration of the time when the ultrasonic wave is reflected back to the objects, a predetermined time For example, 100ms goes through a dormant state (S120).

Thereafter, the reflected wave through the ultrasonic sensor 116-1 is measured to determine an object in front of the intelligent digital module 100, 200, ..., N equipped with the ultrasonic sensor 116-1, or a distance to a user. Calculate and store (S130, S140).

Next, in order to disappear all of the ultrasonic waves emitted from one intelligent digital module, after a predetermined time, for example, 200ms sleep state (S150), the intelligent digital module (100, 200, ..., in the scanning target area) N) check whether all the scanning is completed (S160), and if the scanning is not all completed, repeat the steps (S110 ~ S150).

If the scanning is completed and the distance measurement for each intelligent digital module 100, 200, ..., N is completed, the global coordinator 10 stores each intelligent digital module 100, 200, ..., in step S140. By analyzing the measurement distance data for each N) (S170), it is determined whether a person or an object is detected on the front of the intelligent digital wall (S180), and if a person or an object is detected, with the detected person or object The location data is used for various applications.

Although the present invention has been described with reference to the most practical and preferred embodiments, the present invention is not limited to the above-described embodiments, but includes various modifications and equivalents within the scope of the following claims.

According to the present invention, the following effects are achieved.

1. Modularization: It uses various combinations of intelligent digital modules to pursue various functional transformations by inputting and outputting various information according to the perceived situation, and computing resources inherent in many intelligent digital modules participating in specific scenarios. The effective combination of can show highly coordinated collective responses.

2. Polymorphism: It shows the possibility of converting various functions through the state transition applied to the intelligent digital wall which is a collection of intelligent digital modules. For example, functions of a TV, a radio, a computer, and a video phone can be implemented through the same hardware.

3. Adaptability: An adaptive response to a series of sensed events by intelligent digital wall, a collection of intelligent digital modules, that changes its state based on the user's direct needs or the interpretation of the contextual information obtained by himself. Can be implemented.

4. Multi-modality: The intelligent digital wall, which is a collection of intelligent digital modules, can organically interact with the user through various input / output methods such as voice recognition, gesture recognition, physical contact, PDA, laser pen, and the Internet.

Claims (20)

In the intelligent digital module for polymorphic function conversion, A perception unit for sensing a state or change of state of the surroundings; A reaction unit displaying various types of information in response to a state or a state change detected by the perception unit; A display unit for displaying visual information; And Computing unit for processing the signal output from the perception unit to display the corresponding reaction information through the reaction unit or the display unit Including; The computing unit may change various types of information displayed through the reaction unit and the display unit according to the position and situation of the user sensed by the perceptual unit. Intelligent digital module, characterized in that. The method of claim 1, The perception portion, It includes a variety of sensors for detecting a state or change of the surroundings, The various sensors include an environmental sensor for measuring a state of the surroundings and an action sensor for detecting a change in activity of a user. Intelligent digital module, characterized in that. The method of claim 2, In the environmental sensor, A temperature sensor for measuring an ambient temperature; A humidity sensor for measuring ambient humidity; And Ambient light sensor to measure ambient light At least one of In the behavior sensor, A camera for photographing an external image; A microphone for receiving an external voice; A touch sensor for sensing a touch input from the outside; And Ultrasonic sensor detects the user's location through ultrasound Infrared sensor to detect infrared signals from the remote control At least one of which is included Intelligent digital module, characterized in that. The method of claim 1, The computing unit, A central processing unit (CPU) for performing overall control; A memory for temporarily storing data necessary for the operation of the CPU and data necessary for various processes; A hard disk storing data used in the computing unit or data output from the perceptual unit; And A display controller which controls time information displayed on the display unit under the control of the CPU Intelligent digital module comprising a. The method of claim 1, The computing unit displays a large size of the visual information screen displayed through the display unit when the position of the user sensed by the perception unit is far away than when it is located near the intelligent digital module. Intelligent digital module. The method according to any one of claims 1 to 5, When the display unit is disposed toward the front surface, the perceptual unit and the reaction unit is disposed on a strip-shaped PCB substrate located adjacent to any one of the left and right sides of the display unit. The method of claim 6, The computing unit is disposed on the rear of the display unit, The perceptual part, the reaction part, the display part, and the computing part are accommodated in a case of a cuboid. Intelligent digital module, characterized in that. In the intelligent digital wall for polymorphic transformation, Two or more intelligent digital modules capable of independently detecting a state or a change in state and displaying a corresponding response independently; And A global coordinator that is connected to each of the two or more intelligent digital modules through wireless communication and controls the collective operation of the two or more intelligent digital modules by combining the two or more intelligent digital modules. Intelligent digital wall containing. The method of claim 8, The global coordinator may be configured to respond to the at least two intelligent digital modules based on an adaptive response corresponding to a series of sensed events based on a user's request or recognition of contextual information detected by at least one of the two or more intelligent digital modules. Intelligent digital wall, characterized by a modular implementation. The method according to claim 8 or 9, Each of the two or more intelligent digital modules, A perception unit for sensing a state or change of state of the surroundings; A reaction unit displaying various types of information in response to a state or a state change detected by the perception unit; A display unit for displaying visual information; And A local coordinator for processing a signal output from the perception unit to display corresponding response information through the reaction unit or a display unit, or to transmit a signal output from the perception unit to the global coordinator; And A wireless LAN unit connected to the local coordinator and transmitting information through wireless communication with the global coordinator. Including; The global coordinator changes the position and shape of visual information displayed through the display units mounted on the two or more intelligent digital modules according to the position of the user sensed by the perception unit. Intelligent digital wall, characterized in that. The method according to claim 8 or 9, Intelligent digital wall, characterized in that the two or more intelligent digital modules are built in a stacked manner to form the intelligent digital wall. The method according to claim 8 or 9, Intelligent digital wall, characterized in that the two or more intelligent digital modules are inserted in a form interconnected to the grid metal frame to form the intelligent digital wall. The method of claim 10, And wherein said global coordinator is located in one of said two or more intelligent digital modules or in a separate computer. The method of claim 10, When the position recognition sensors of the perception parts of the two or more intelligent digital modules are arranged at regular intervals with respect to the intelligent digital wall surface, the global coordinator uses the position recognition sensor to set a predetermined distance in front of the intelligent digital wall surface. And periodically measuring the position of the user to control the position and size of the visual information screen through the plurality of reaction units or display units. The method of claim 10, Each of the two or more intelligent digital modules is provided with a microphone for receiving a voice, and the global coordinator collects the user's voices input through the microphones provided in the two or more intelligent digital modules and finally recognizes the user's voice command. Intelligent digital wall characterized in that. The method of claim 10, Each of the two or more intelligent digital modules is equipped with an infrared sensor capable of receiving an external infrared signal input, and the global coordinator receives an infrared signal input transmitted through an external remote controller received through each of the intelligent digital modules to receive a user command. Intelligent digital wall, characterized in that processing. The method of claim 10, One of the two or more intelligent modules performs a web server function, And the web server acts as a web interface for controlling the two or more intelligent modules by receiving a user's command through a terminal accessible to the web server through the Internet. The method of claim 10, One of the two or more intelligent modules performs a server function, And the server operates as a wireless interface for controlling the two or more intelligent modules by receiving a user's command through a mobile terminal such as a PDA that can be connected to the server through wireless LAN communication. The method of claim 10, Acquiring a face image of the front user through a camera attached to the two or more intelligent digital modules, and based on matching with a plurality of face images registered in a database through face recognition software installed in the corresponding intelligent digital module. Intelligent digital wall, characterized in that it is used to provide an application service considering personal preferences after identifying the identity of the user. The method of claim 10, Through a touch screen installed on one or both of the two or more intelligent modules, a user can directly control one or more intelligent digital modules by manipulating graphical user interface elements output to a specific intelligent digital module. Intelligent digital wall, characterized as an interface.