KR100857533B1 - Interactive electronic frame system based on network - Google Patents

Abstract

In the present invention, a network-based interactive electronic frame system having a remote monitoring or remote protection function is detected based on the movement pattern of the user.

According to an embodiment of the present invention, there is provided an electronic picture frame system for receiving and displaying a plurality of video screens online, the electronic picture frame comprising: a human body sensor for detecting a movement pattern of a user approaching the electronic picture frame; And accumulate the detection result of the human body sensor by a predetermined time unit, generate user life pattern information following the user's life pattern by time zone and date based on the accumulated result information, and based on the user life pattern information, And a control device for determining a user state of the detection result of the detection sensor and mounting the determination result online, after receiving the determination result online, reading a user status message corresponding to the determination result, And a content server for notifying the user status message to the authentication manager terminal authenticated with respect to the user. Therefore, the present invention, by realizing to transmit a message requiring immediateness through the electronic frame when the risk state for the user (elderly person) is recognized, real-time management and confirmation of the elderly can be made to give practicality of the system. .

Online, Digital Picture Frame, Human Body Detection, Message, Life Pattern, Probability

Description

Network-based interactive electronic frame system {INTERACTIVE ELECTRONIC FRAME SYSTEM BASED ON NETWORK}

1 and 2 are diagrams for explaining a conventional electronic frame.

3 is a block diagram showing an interactive electronic frame system according to the present invention.

4 is a main configuration diagram illustrating the electronic picture frame function of FIG. 3.

5 is a flowchart for explaining the main operation of the present invention.

6 is a diagram illustrating detection results and user life pattern information of the human body sensor according to an embodiment of the present invention.

<Explanation of symbols for main drawings>

301: electronic frame 311: human body detection sensor

321 communication network 323 Internet server

325 content server 401 control unit

403: Data storage unit 405: Program storage unit

407: communication unit 409: sensor driver

411: text operation unit 413: graphic operation unit

The present invention relates to an electronic picture frame system, and more particularly, to determine the presence of a user, and to transmit a message requiring immediateness according to the determination result, or an alarm at a space separated from the accumulated user's movement pattern. It relates to a network-based interactive electronic frame system that can perform.

In general, modern communication forms have formed a visual-oriented visual culture with the development of various mass media along with the advancement of scientific civilization and rapid industrial economy. Therefore, the form of new communication media is changing from complex media, not just visual media. The audiovisual composite media can be stored through a storage medium such as a computer hard disk or a CD, but in recent years, a computer having an electronic picture frame function has been released. Search for discs or CDs and display them on the computer monitor.

Fig. 1 shows a monitor having the above-mentioned conventional electronic picture frame function. 2 is a block diagram showing the configuration of a liquid crystal display monitor for performing an electronic picture frame function. For reference, the liquid crystal panel 110 converts and displays various electrical information generated by various devices into visual information by using a change in transmittance of the liquid crystal according to an applied voltage; An outer case 120 in which the liquid crystal panel 110 is accommodated; An electronic frame function button 135 provided at one end of the exterior case 120 and displaying a picture or a picture on the liquid crystal panel 110 according to a button press; A memory 140 for storing a picture or a picture for display on the liquid crystal panel 110; A microprocessor 150 which detects that the electronic frame function button 135 is pressed and displays a picture or a picture stored in the memory 140 on the liquid crystal panel; And a monitor input terminal 160 for receiving data from the PC main body 200 or other device such as a digital camera.

The electronic picture frame function button 135 generally adjusts the specifications of the monitor, such as screen brightness and contrast, tuning, RGB (Red, Green, and Blue) adjustment, and up / down / left / right size and position adjustment of the screen. In addition to the plurality of function buttons 130 used to install or use the plurality of function buttons, but changes the firmware of the monitor to perform the electronic frame function.

In addition, the monitor is generally used in a state where the power of the monitor is connected, but when the power is turned off, the auxiliary power supply 180 for supplying power to the liquid crystal display monitor is additionally provided so that the power is not connected to the monitor. It is configured to operate at any time, and it adopts a remote controller to make it easy to express a desired picture.

However, as described above, the monitor having the electronic picture frame function simply displays the picture information, and has a structure in which only the primary function of the electronic picture frame is given. Therefore, it is pointed out that the conventional electronic picture frame lacks functionality in real life by granting a frame function by utilizing only some functions of a computer.

The present invention was created to solve such a problem, and an object of the present invention is to recognize the proximity of the user as an electronic frame to transmit a message requiring immediateness, the remote protection function for the elderly or infants It is to provide a network-based interactive electronic frame system that can be given.

Another object of the present invention is to provide a network-based interactive electronic frame system that can recognize and notify the emergency situation by monitoring the movement for the elderly using the electronic frame.

Network-based interactive electronic frame system according to an aspect of the present invention for achieving the above object, in the electronic frame system for receiving and displaying a plurality of video screens on-line, the electronic frame is close to the electronic frame A human body sensor for detecting a movement pattern of the user; And accumulate the detection result of the human body sensor by a predetermined time unit, and generate user life pattern information following a user's life pattern by time zone and date based on the accumulated result information, and based on the user life pattern information. And a control device for determining a user state of the detection result of the current human body detection sensor and mounting the determination result on-line. After receiving the determination result on-line, the user status message corresponding to the determination result is included. And a content server for notifying the user status message to the authentication manager terminal authenticated for the user.

According to a preferred embodiment of the present invention, the authentication manager terminal requests to transmit a message, and the content server is characterized in that the message transmission to the electronic frame in response to the message transmission request.

In addition, the user lifestyle pattern information is numerical information that calculates the probability of the user being detected at the corresponding time and date by collecting the accumulated result information by time zone and date, and the user state determination is based on the user lifestyle pattern information. And setting a numerical reference range, and determining whether the detection result of the human body sensor is included in the reference range when the determination is required.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, the network-based interactive electronic picture frame system according to the present invention includes a sensor for detecting a human body in the front of the electronic picture frame, and notifies a signal detected from the sensor to a specific region through the wired or wireless Internet, and detects the detection result of the sensor. By accumulating and following a user's movement pattern, it has a function of detecting an emergency situation for the user. On the other hand, the human body sensor applied in the present invention can follow the user's behavior pattern by time zone using the infrared sensor, or the user's time zone behavior pattern with the user's time zone using the human body sensor using the thermal sensor, You will be able to detect changes in body temperature. Of course, using the infrared sensor and the thermal sensor at the same time, or even if the behavior pattern of the user is detected using a plurality of electronic frames will not depart from the gist of the present invention.

The aforementioned time zone behavior pattern indicates a pattern of movement by time zone, day of the week, and month for the user. Therefore, in the present invention, it is preferable to install the electronic frame in a position where the life radius of a specific family member or the elderly is most overlapped.

3 is a block diagram showing an interactive electronic frame system according to the present invention. As shown, the electronic frame 301 includes a frame 303 having a predetermined shape and a display panel 305 configured to display an arbitrary screen by being formed inside the frame 303, and the frame 303 A control button 309 for transmitting a user control signal to one side of the user, a human body sensor 311 for detecting a user's movement pattern, and the arbitrary screen are provided online, and a user's control signal and the human body It consists of a communication line 307 for transmitting the detection result of the detection sensor 311 online. The communication line 307 is connected to the Internet server 323 and the content server 325 via a communication network 321.

The electronic frame 301 configured as described above is connected to, for example, the Internet via the communication line 307, and receives a predetermined screen from the content server 325 provided on the Internet. The content server 325 stores and manages an arbitrary screen designated by the user. Here, the management of any screen includes time management for controlling the screen to be transmitted to the display panel 305, selection of a transmission screen, authentication management for electronic frames, user information management, and the control button 309. Screen output control and the like.

The detection result of the human body sensor 311 is transmitted to the content server 325 and notified to a plurality of authorized administrator terminal. The authenticated administrator may be a family, guardian, or the like of the user who uses the electronic frame 301. Therefore, the authentication manager terminal used by the family, the guardian, etc. is spaced apart from the electronic picture frame 301 and connected to the communication network 321. The detection result of the human body sensor may generate life pattern information of the user, and in response to the user life pattern information, the authentication manager terminal may transmit a message to the display panel 305. The message may be text information, graphic information, voice information, and the like.

On the other hand, the user life pattern information is generated in the electronic frame 301, or generated in the content server is provided to the authenticated administrator. That is, the electronic picture frame 301 may accumulate and manage the movement patterns of the user by using the human body sensor 311 and generate user life pattern information based on the accumulated movement patterns of the user. Alternatively, the content server 325 may infer a user's movement pattern based on the detection result of the human body sensor 311 provided from the electronic picture frame 301, and generate user life pattern information based on this.

The user life pattern information includes the user's life pattern including analysis information analyzed by the human body sensor 311 according to time, date, day of the week, month, year, weather, event, etc. The judgment result of determining whether the range is normal is included.

4 is a view showing the main configuration of the electronic picture frame according to the present invention, it will be an embodiment of the present invention that the electronic picture frame generates user life pattern information. Of course, the user life pattern information may be generated in the content server, and in the present embodiment, it will be limited to the electronic picture frame to avoid duplicate description.

As shown, a text operation unit 411 for processing text information (OSD) on the display panel 305, providing an electronic picture frame on the display panel 305, or the authentication manager terminal A graphic operation unit 413 for displaying an arbitrary screen provided from the data storage unit 403 for storing time information corresponding to a detection signal in the human body sensor 311, and the human body sensor 311. A program storage unit 405 for storing a program for generating situation pattern information of a user corresponding to a detection result and a system operation program, and the internet server 323 and a content server based on a protocol accessible to the communication network 321. A communication unit 407 for performing data communication to 325, and parses data flowing through the communication unit 407, based on the parsing result. The data is transmitted to the test operation unit 411 and the graphic operation unit 413, and the electronic frame screen is selectively output according to the user setting, and the user life pattern information is loaded into the communication network 321 in response to the authentication manager's request. It consists of a control unit 401 for the following.

The control unit 401 interoperates with a sensor driver 409 for receiving the output result of the human body sensor by operating the human body sensor 311, and an authentication key generator 417 for assigning a unique number of the electronic frame. ) Is connected. In addition, the input terminal of the controller 401 is connected to the key input unit 415 for the user to selectively screen the electronic picture frame. The key input unit 415 temporarily sets a display order, display time, etc. of a plurality of electronic frame screens provided by the content server 325, that is, a screen preset by a user.

The authentication key generator 417 may use a dip switch of a predetermined bit as an encryption key for setting a unique number for the electronic picture frame. If necessary, the encryption key of the authentication key generation unit 417 may be provided in the data storage unit 403.

5 is a flowchart for explaining the main operation of the present invention.

As shown, the process proceeds to step S501 to perform a system initialization. In the system initialization, the electronic frame 301 is connected to the communication network 321, completes the authentication procedure for the electronic frame 301, and completes the registration of the screen information to be displayed by the user to the electronic frame 301 . In addition, the authentication manager terminal of the authentication manager, which is the guardian of the user, is connected to the communication network 321 and completes the system synchronization and authentication to receive the user life pattern information from the content server 325.

As such, when the system initialization is completed, the electronic frame screen set by the user is displayed on the display panel 305 with a predetermined rule. Here, the predetermined rule includes a display order, a display time, and the like of a screen provided based on a user setting.

On the other hand, the human body sensor 311, which is installed in the front part of the electronic picture frame 301 is to determine whether the user is located in the front position of the electronic picture frame 301, an infrared sensor, a heat detection sensor or the like is used. The human body sensor 311 determines whether the user is close to the electronic frame with the system initialization. For example, the human body sensor 311 determines whether the user enters a room where the electronic frame 301 is fixed or determines whether the user is located in a living room where the electronic frame 301 is fixed. That is, the electronic frame 301 receives the detection result from the human body sensor 311 by entering the step S503.

The signal detected by the human body sensor 311 is applied to the control unit 401 through the sensor driver 409, and the control unit 401 stores the detection result in the data storage unit 403. The controller 401 stores current time information, date information (day information), and the like together with the detection result. Here, the detection result may be stored in units of seconds, and may be stored in units of minutes or hours in consideration of the capacity of the memory. 6A is a graph showing the detection result of the human body sensor. As shown, it is composed of a time axis (horizontal axis) and a date axis (vertical axis), and the time axis is applied to any one of seconds, minutes, and time units as described above.

The data storage unit 403 detects the presence of a user in units of set time (seconds, minutes, hours) and accumulates the data in units of dates D1, D2, D3, .... Therefore, as shown in the figure, the user is present from the T1 time to the T4 time on the D1 date (within the radius detectable by the human body sensor of the electronic frame), the user is not present at the T6 time, and the time is from the T5 time to the T7 time. Again it is detected that the user exists. In this operation, the signal detected by the human body sensor is counted in units of time in step S505, or the signal not detected by the human body sensor is counted in units of time as in step S507.

In operation S509, the controller 401 detects the presence or absence of the user on an hourly basis using the human body sensor 311, and stores the data storage 403 for each hour and every day. At this time, the count information performed in the previous step is stored together. The controller 401 may expand the data analysis by classifying by day in storing the detection result of the human body sensor by date.

As shown in FIG. 6A, the controller 401 accumulates data on an hourly basis and on a date basis based on the detection result of the human body sensor 311. In the drawing, the opaque horizontal bar is time information of detecting a user by the human body sensor 311. That is, the user counts the time at which the user is located at a place that can be detected by the human body sensor 311 of the electronic picture frame 301 and stores it. Thereafter, the controller 401 enters step S511 to activate the program storage unit 405.

The control unit 401 receives a life pattern generation program of the user from the program storage unit 405. The controller 401 starts a user life pattern generation program and reads the detection result of the human body sensor stored in the data storage unit 403. The controller 401 accumulates time, date, and day of the week based on the detection result of the human body sensor accumulated up to now. In step S513, the control unit 401 calculates the cumulative data on the detection result as a percentage and classifies the data by time, date, and day of the week. As shown in (b) of FIG. 6, it is classified by time zones (T1, T2, T3, ...) and by date (weekdays, Saturdays, Sundays, and holidays).

For example, if today is Saturday and T1 time, the probability that the user will be detected by the electronic picture frame 301 is 87%. And it becomes 92% in the same time (T1) zone on Sunday which is the next day. If the user is not continuously recognized by the human body sensor 311 on today (Saturday) and the next (Sunday), it may be regarded as an abnormal state. On the other hand, in the T10 and T11 time zones on weekdays, when the user should not be recognized, if the user is recognized by the human body sensor 311 during the corresponding time zone, this may also be regarded as an abnormal state.

As described above, the electronic picture frame 301 generates user life pattern information based on the detection result of the human body sensor and transmits it to the content server 325 through the communication network 321. The user life pattern information may be uploaded for a set time period, and the content server 325 collects user life pattern information provided from the electronic frame 301 in real time. That is, the controller 401 stores the detection information of the human body sensor in the data storage unit 403 on a predetermined time basis, and then, based on the user life pattern information generation program of the program storage unit 405, the user life pattern information is stored. Create The user life pattern information generated as described above is transmitted to the content server 325 together with the unique number provided by the authentication key generator 417.

The content server 325 accumulates the user life pattern information in real time based on the unique number of the electronic picture frame 301. At this time, the content server 325, in step S515, determines whether the detection result of the currently detected human body sensor is out of the normal range of the user life pattern. The above-described normal range indicates a reference value of the user's life pattern information, and determines whether the probability that the user is detected by the human body sensor 311 at a certain date and any time period exceeds a preset reference value. For example, when the probability that the user is detected by the human body sensor 311 is 80% or more, if the user is not detected by the human body sensor 311, it is determined that the user is out of the normal range, while the user detects the human body sensor 311. When the probability of detection is 30% or less, when the user is detected by the human body sensor 311, it may be determined that the deviation from the normal range. As such, the baseline value may be defined as an empirical value of the authentication manager and may be set by the system operator.

Accordingly, the content server 325 may determine whether the current user's life pattern exists in the normal range, and read the warning message as shown in step S517 or read the steady state guide message as shown in step S521. . Message generation is memory data previously stored in the content server 325. The content server 325 transmits a message for notifying the current state to the authentication manager terminal in step S519, and the authentication manager may provide a real time message to the content server 325 according to the content of the message. The content server 325 transmits the message provided from the authentication manager terminal to the electronic frame 301.

The content server 325 provides a message of the authentication manager, which requires immediateness, to the communication unit 407 of the electronic frame 301 through the communication network 321 based on a predetermined communication protocol. The control unit 401 parses the message received from the communication unit 407, determines whether the received message is text or graphic, and checks the text operation unit 411 or the graphic operation unit 413 according to the determination result. Let it be. Accordingly, the display panel 305 displays a message provided from the authentication manager terminal. The message provided from the authentication manager terminal is a message requiring immediateness. When a user is detected by the human body sensor 311, the authentication manager may transmit a greeting message to the user.

In addition, when the human body sensor 311 has a low probability of recognizing the user, when a warning message indicating that the user exists in the authentication manager terminal is notified, the authentication manager may ask for safety to the user by using a wired or wireless telephone. Could be.

Meanwhile, as described above, the user life pattern information according to the present invention may be generated by the content server 325 without generating the electronic picture frame. That is, the electronic picture frame 301 detects only the presence of a user from the human body sensor 311 and mounts it on the communication network 321 to provide the content server 325 in real time. The content server 325 stores and manages data by time zone, date, and day of the week. Then, the user life pattern information generation program stored in advance is started by the content server 325 to calculate a probability that the human body sensor detects the user by date, day of the week, and time zone.

The calculated user life pattern information determines whether the detection result provided from the human body sensor 311 of the current electronic picture frame 301 is normal. That is, the content server 325 determines whether it is normal or dangerous for the user to exist in the current time zone (current day and date), and transmits the determination result to the authentication manager terminal. The authentication manager terminal may transmit a message requiring immediateness to the electronic frame 301 or perform a wired or wireless call based on the determination result of the content server 325.

Of course, as described above, the electronic frame or the content server determines the risk state of the presence of the user in the current time zone, but the authentication manager can arbitrarily determine the risk state of the user based on the accumulated human detection sensor detection results have. For example, when the authentication manager refers to the detection result of the human body sensor, even if the user is not normally detected for a long time, if the user is detected for a long time up to now, the authentication manager immediately detects the user's danger state. This can be confirmed by a message requiring the surname or by wired or wireless telephone.

As described above, the network-based interactive electronic frame system according to the present invention, equipped with a human body sensor for detecting the user to the front of the electronic frame, and whether the presence of the user detected from the sensor by time zone, date By accumulating by day, calculating the probability that the current user is detected by the human body sensor, determining whether the user's behavior pattern is normal or dangerous based on the calculation result, and notifying the installed authentication manager terminal of the determination result. However, there is an effect that the management of the elderly can be done remotely.

In addition, in the present invention, by implementing a message requiring immediateness through the electronic frame when the risk state for the user (elderly person) is recognized, real-time management and confirmation of the elder person can be made to give practicality of the system It works.

While the invention has been shown and described with respect to specific preferred embodiments thereof, the invention is not limited to the embodiments described above, and is typically used in the art to which the invention pertains without departing from the spirit of the invention as claimed in the claims. Anyone with knowledge of the world can make many variations.

Claims (10)

In the electronic frame system for receiving and displaying a plurality of video screens on-line, The electronic frame is a human body sensor for detecting a movement pattern of the user in proximity to the electronic frame; And accumulate the detection result of the human body sensor by a predetermined time unit, and generate user life pattern information following a user's life pattern by time zone and date based on the accumulated result information, and based on the user life pattern information. A control device for determining a user state according to a detection result of the current human body sensor and mounting the determination result on-line; After receiving the determination result on-line, and comprises a content server for reading a user status message corresponding to the determination result, and notifying the user status message to the authentication manager terminal authenticated for the user, The user life pattern information is a network-based interactive electronic picture frame system, characterized in that the collected information by the time period, date by day to calculate the probability of detecting the user at the corresponding date, time. The method of claim 1, wherein the human body sensor, Network-based interactive electronic frame system, characterized in that the infrared sensor or heat sensor. The method of claim 1, The authentication manager terminal requests a message to be transmitted, and the content server performs a message transmission as the electronic frame in response to the message transmission request. The method of claim 3, wherein the message, And a text message, a graphic message, or a voice message requiring immediateness from the user in response to the determination result of the content server. delete The method of claim 1, wherein the user state determination is, And setting a numerical reference range for the user life pattern information, and determining whether a detection result of the human body sensor is included in the reference range. In the electronic frame system for receiving and displaying a plurality of video screens on-line, The electronic frame is a human body sensor for detecting a movement pattern of the user in proximity to the electronic frame; And a communication device for mounting the detection result of the human body sensor on the online on a predetermined time basis. Accumulate the detection result of the human body sensor in real time, generate user life pattern information following the user's life pattern by time zone and date based on the accumulated result information, and present human body sensor based on the user life pattern information A content server for determining a user status of a detection result of the detected data, reading a user status message corresponding to the determination result, and notifying the user of the user status message to an authenticated administrator terminal, The user life pattern information is a network-based interactive electronic frame system, characterized in that the collected information for each time zone, date, the cumulative result calculated the probability of detecting the user at a corresponding time, date. The method of claim 7, wherein the human body sensor, Network-based interactive electronic frame system, characterized in that the infrared sensor or heat sensor. The method of claim 7, wherein In response to a message transmission request from the authentication manager terminal, the content server transmits any one of a text message, a graphic message, and a voice message to the electronic picture frame, which requires immediateness from the user. Based interactive e-frame system. The method of claim 7, wherein the user life pattern information, The user state determination establishes a numerical reference range for the user life pattern information, and determines whether the detection result of the human body sensor is included in the reference range at the time when the determination is required. Type photo frame system.

Images