KR20210146162A - Database linked face analysis system and screen display control method thereof - Google Patents

Abstract

The present invention provides a database linked face analysis system and a screen display control method thereof. The database linked face analysis system includes: an image acquisition part for loading a face image in conjunction with a network-based database (DB) that classifies and stores a plurality of 3D and 2D-based face images according to a corresponding list; a screen display part for displaying the face image loaded in the image acquisition part based on a browser having one or more user interface (UI) areas; and a control part for receiving a user screen control command as an input and controlling the user interface (UI) of the screen display part to analyze the face image while changing one or more view modes.

Description

DATABASE LINKED FACE ANALYSIS SYSTEM AND SCREEN DISPLAY CONTROL METHOD THEREOF

The present invention relates to a database-linked face analysis system and a screen display control method of the system, and more particularly, to a database that stores a plurality of 3D and 2D-based face images, and to output and analyze the face images on a screen by interworking with a database It relates to a database-linked face analysis system and a screen display control method of the system.

With the market expansion of camera phones such as smart phones, digital camcorders, digital cameras, etc., photographing technology and photographing devices for photos and videos are developing day by day. It is possible to obtain the effect of improving the performance of face analysis by pre-registering as many various face images as possible to be photographed with these photographing devices in advance.

Accordingly, a basic reference face image for face recognition of newly photographed or input face images is registered in the database, the stored face images are linked with the database, the captured data is loaded, and various displays are displayed for a specific photo. A system that can analyze in the environment is required.

In addition, in order to meet the needs of a user who uses a face recognition system, an interface for controlling a display device has been proposed in various forms.

In this regard, there is a need for a method of providing an interface screen that is convenient for the user to operate while intuitively providing various information. In addition, when a user easily inputs a command using a user interface (UI), a user in a suitable form is required. It is requested to find a way to provide a menu.

As a prior art for the above-required problem, Korean Patent Laid-Open No. 10-2017-0049199 (2017.05.10.) discloses a display device and a method for controlling a screen display of the display device.

However, the prior art intends to provide a method for the user of the display device to identify which remote control device is currently being used and to recommend a list of contents that can use the identified remote control device to the user. , as in the present invention, in conjunction with a database (DB) that stores a plurality of 3D and 2D-based face images according to the corresponding list, a user interface (UI) for facial image analysis is provided according to various view modes. It is different from the face analysis system that analyzes the face image according to the

The present invention was derived to solve the problems of the prior art described above, and an object of the present invention is to classify and store a plurality of 3D and 2D-based face images by group according to the corresponding list by interworking with a database (DB), An object of the present invention is to provide a database-linked face analysis system that provides a user interface (UI) for analyzing a face image and analyzes a face image according to various view modes, and a method for controlling a screen display of the system.

In addition, in the present invention, when a direction change, enlargement/reduction, or movement of any point of one face image is performed according to a user screen control command with respect to the face image displayed on the browser of the screen display unit, the face image of the other side is displayed The purpose is to provide a function that is synchronized and moves together.

A face analysis system according to an aspect of the present invention for solving the above technical problem loads a face image in conjunction with a network-based database (DB) that classifies and stores a plurality of 3D and 2D-based face images according to a corresponding list ), a screen display unit that displays the face image loaded in the image acquisition unit based on a browser having one or more user interface (UI) areas, and a user screen control command received as input, the screen display unit It is characterized by including a controller to analyze the face image while changing one or more view modes by controlling the user interface (UI).

In addition, in the present invention, the list of the database (DB) is a list that distinguishes the owner's name, gender, date of birth, and shooting date of the face image, and according to the list, the face image is stored for each group.

In addition, the database (DB) of the present invention is an open source-based relational database management system (RDBMS) based on either PostgreSQL (PostgreSQL) or MariaDB (MariaDB) is characterized.

In addition, the browser of the screen display unit of the present invention is fixed in the form of a horizontal bar at the top to provide one or more menus displayed as icons, detailed information and views of the face image uploaded to the first area and a certain area on the left It has a characteristic of being divided into a second area providing a menu for selecting a (View) mode and a third area displaying a face image according to a view mode as a predetermined area on the right side.

In addition, the view mode of the present invention is divided into a 3D single mode or a 3D dual mode, and the 3D single mode is the left half of the third region expressing a face image. area, and provides a screen in which 2D thumbnail photos with individual numbers are listed in the remaining right area, and the 3D Dual mode is a different face image in the left half of the third area and the remaining right area , and 2D thumbnail photos with individual numbers are provided in the form of a bar at the bottom.

In addition, in the 3D dual mode of the present invention, with respect to two different face images expressed in the third area, direction change, enlargement / enlargement / When zooming out or moving, the face image on the other side is synchronized to provide a function to move together.

In addition, the method for controlling the screen display of a database-linked 3D face analysis system according to another aspect of the present invention for solving the above technical problem includes the steps of logging into the system through user authentication for access to the face analysis system, dividing into one or more areas A step of displaying a browser composed of a user interface (UI) that becomes There is a feature comprising the step of analyzing the face image while changing.

In addition, in the system login step of the present invention, user authentication may be confirmed by inputting a license ID value and a user password of the face analysis system.

In addition, the view mode in the step of analyzing the face image of the present invention is divided into a 3D single mode or a 3D dual mode, and the 3D single mode is the left side of the third region It is to provide a screen in which half is an area displaying a face image, and 2D thumbnail photos having individual numbers are listed in the remaining right area, and the 3D Dual mode is the left half and the rest of the third area. Different face images are displayed in the right area, and 2D thumbnail photos having individual numbers in the form of a bar at the bottom can be provided in a row.

In addition, the 3D dual mode of the present invention changes the direction, enlarges / When zooming out or moving, the face image on the other side is synchronized to provide a function to move together.

The present invention according to the above-described database-linked face analysis system and the screen display control method of the system provides a user interface (UI) for analyzing a face image and analyzes the face image according to various view modes, It has the effect of improving the analysis ability for photos.

In addition, the present invention has the effect of providing a means for calling a specific picture, such as "Let's see a few pictures," when discussing with other people from the user's point of view, since each thumbnail is individually numbered. .

In addition, in the present invention, when a direction change, enlargement/reduction, or movement of any point of one face image is performed according to a user screen control command with respect to the face image displayed on the browser of the screen display unit, the face image of the other side is displayed By providing a function to move together in synchronization, it has the effect of improving the facial image analysis ability for different images.

1 is a block diagram showing the configuration of a face analysis system interworking with a database according to an embodiment of the present invention.
2 is a flowchart illustrating a screen display control method for a face analysis process of a face analysis system interworking with a database according to an embodiment of the present invention.
3 is an exemplary view showing a login screen of a face analysis system according to an embodiment of the present invention;
4 is an exemplary diagram showing a screen configuration of a browser of a face analysis system according to an embodiment of the present invention;
5 is an exemplary view showing a photographing data selection menu for loading a face image of the face analysis system according to an embodiment of the present invention;
6 is an exemplary diagram showing a 3D view-A type screen configuration in 3D single mode of the face analysis system according to an embodiment of the present invention;
7 is an exemplary diagram of individually numbered 2D thumbnail images of a face analysis system according to an embodiment of the present invention;
8 is an exemplary view showing the screen configuration of the 2D view-A type in the 3D single mode of the face analysis system according to an embodiment of the present invention;
9 is an exemplary view showing a full-screen A-type screen in 3D single mode of the face analysis system according to an embodiment of the present invention;
10 is an exemplary view showing a 3D view-A type screen configuration in 3D dual mode of the face analysis system according to an embodiment of the present invention;
11 is an exemplary view showing the screen configuration of the 2D view-A type in the 3D dual mode of the face analysis system according to an embodiment of the present invention;
12 is an exemplary diagram illustrating a B-type full screen screen in a 3D dual mode of the face analysis system according to an embodiment of the present invention.

The terms or words used in the present specification and claims should not be construed as being limited to their ordinary or dictionary meanings, and the inventor may properly define the concept of the term in order to best describe his invention. Based on the principle that there is, it should be interpreted as meaning and concept consistent with the technical idea of the present invention.

Therefore, the configuration shown in the embodiments and drawings described in this specification is only the most preferred embodiment of the present invention and does not represent all of the technical idea of the present invention, so various equivalents that can be substituted for them at the time of the present application It should be understood that there may be water and variations.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of a face analysis system interworking with a database according to an embodiment of the present invention.

As shown in the figure, the face analysis system of the present invention is linked with a database (DB) 200 which is a network-based storage device that classifies and stores a plurality of 3D and 2D-based face images by group according to a corresponding list.

At this time, the database (DB) 200 is an open source-based relational database management system (RDBMS) based on either PostgreSQL or MariaDB, so that numerous simultaneous access users from a single machine application It can manage multiple loads, ranging from large Internet applications to large Internet applications.

Accordingly, the face analysis system 100 includes an image acquisition unit 110 , a screen display unit 120 , a user command input unit 140 , and a control unit 130 , and may further include a storage unit 150 and a communication unit. .

The image acquisition unit 110 performs a function of uploading a face image in conjunction with a database (DB) 200 .

The screen display unit 120 may be referred to as a display screen configured to display the uploaded face image and a user interface (UI).

The control unit 130 receives a user screen control command as an input, operates a browser, and controls a user interface (UI) of the browser to analyze the face image while changing the view mode. carry out In addition, the control unit performs a function of controlling system settings such as license ID registration, password change, and AP WiFi setting for interworking with the database (DB) and system login.

That is, the screen display unit 120 displays a user interface (UI) on a browser, but has a flexible property of a display area according to a change in the size of the browser.

In addition, the browser of the screen display unit 120 includes a first area as a main menu area that provides one or more user interfaces (UIs) displayed as icons fixed in the form of a horizontal bar at the top, and a predetermined area on the left side of the screen display unit. The second area that provides the user interface (UI) menu to select the view mode and detailed information of the face image uploaded to The third area is provided as a basic configuration.

In this case, in the second area, the contents of the displayed content may vary according to the selection of the main menu presented in the first area, and in the third area according to the selection of the view mode provided in the second area. View mode is controlled.

The view mode provided in the third area may be divided into a 3D single mode and a 3D dual mode. In this case, the 3D single mode is the left half of the third area. It is an area that displays a face image, and provides a screen in which 2D thumbnail photos are listed in the remaining right area, and the 3D Dual mode shows different faces in the left half of the third area and the remaining right area. It is a screen mode that displays an image and provides 2D thumbnail photos arranged in a bar form at the bottom.

In this case, in the 3D dual mode, if the direction is changed, enlarged/reduced, or moved to an arbitrary point in one face image according to a user screen control command for two different face images, the other face The ability to synchronize images and move them together is provided.

With the configuration of the face analysis system as described above, the screen display control method for the face analysis process will be described in detail as follows.

Accordingly, FIG. 2 is a flowchart illustrating a screen display control method for a face analysis process of a face analysis system interworking with a database according to an embodiment of the present invention.

As shown in the figure, the screen display control method of the database-linked 3D face analysis system of the present invention includes a system login step (S100), a browser display step (S200), a face image loading step (S300), and a face image analysis step (S400). ) is included.

3 is an exemplary view showing a login screen of a face analysis system according to an embodiment of the present invention, wherein the system login step (S100) is a step of accessing a system for user authentication for access to the face analysis system. A login screen 10 of the analysis system is displayed, and user authentication is confirmed by inputting a license ID value and a password of the face analysis system to the login screen 10 .

The browser display step S200 is a step in which, when user authentication is recognized in the system login step, a web browser screen 20 providing a user interface (UI) for interworking with a database is output.

4 is an exemplary diagram illustrating a screen configuration of a browser of a face analysis system according to an embodiment of the present invention.

The browser may be either a web browser or a window browser, and has a flexible property in which the size of the display area changes according to a change in the size of the browser.

In this case, the browser provides a user interface (UI) area divided into one or more areas.

The user interface (UI) area displayed on the browser includes a first area 21 that is fixed in the form of a horizontal bar at the top of the browser and provides one or more main menus displayed as specific icons, and a predetermined area on the left side of the browser. It is divided into a second area 22 for providing detailed information and a side menu of the uploaded face image, and a third area 23 for directly expressing the face image in a certain area on the right side of the browser.

In this case, the content of the content displayed in the second area 22 may vary according to the selection of the main menu presented in the first area 21 .

In the face image loading step (S300), when the loading menu of the photographed data on the first area 21 is selected, the date of the photographed data for each image stored in the database is displayed in the second area 22, and the This is a step of loading a photographed image by searching for and selecting the date of photographing data recorded in the order of time and image information on a specific face displayed in the second area 22 .

5 is an exemplary view showing a photographing data selection menu for loading a face image of the face analysis system according to an embodiment of the present invention.

After the face image loading step ( S300 ), the face image of the photographed data stored in the database is displayed on the browser screen 20 . At this time, at the time of initial loading, properties such as a specific direction and enlarged state are given, and the image size is expressed in a horizontal: vertical, 3:4 ratio.

In addition, in the face image loading step ( S300 ), the browser displays a side menu for designating a view mode of the third area 23 in the second area 22 .

The view mode may select a 3D single mode, a 3D dual mode, and a 2D UV mode.

In this case, the 3D single mode is a mode in which the screen is switched to 3D view-A type, 2D view-A type, and A-type full screen. The default type of the 3D single mode is set to 3D view-A type.

In addition, the 3D dual mode has a screen switching mode divided into 3D view-B type, 2D view-B type, and B-type full screen. At this time, the default type is set to 3D view-B type.

6 is an exemplary diagram illustrating a 3D view-A type screen configuration in a 3D single mode of the face analysis system according to an embodiment of the present invention.

The 3D view-A type is a 3D image area in which the left half of the third area displays a 3D face image, and 2D thumbnails, that is, a 2D thumbnail that provides a screen in which preview small photos are listed in the remaining right area. This is the view mode in which the area is presented.

7 is an exemplary diagram of a 2D thumbnail image of a face analysis system according to an embodiment of the present invention. At this time, each thumbnail is assigned an individual number 30 for an individual image. , "Let's see some pictures." It will provide a means for calling a specific picture.

In the face image analysis step (S400), the face image is analyzed while changing the view mode through a screen control command.

That is, face image analysis in 3D view-A type can be performed through user commands such as direction designation and enlargement/reduction while controlling the 3D image area in the 3D view-A type with a mouse, which is one of the user command input units. .

8 is an exemplary view showing the screen configuration of 2D view-A type in 3D single mode of the face analysis system according to an embodiment of the present invention, wherein the 2D view-A type is the 3D view-A type When a specific thumbnail is selected, the original 2D image of the specific thumbnail is displayed in the left half area of the third area, and the 2D thumbnail is presented as it is in the remaining right area.

Accordingly, in the 2D view-A type, the original 2D image can be viewed while continuously replacing small preview photos of the 2D thumbnail area.

In this case, the image can be flipped left and right through the direction button of the mouse or keyboard of the user command input unit. Other user commands such as zoom in/out and direction movement by the mouse are equally applied.

9 is an exemplary view showing the A-type full screen screen in the 3D single mode of the face analysis system according to an embodiment of the present invention, and the full-screen enlargement icon a in 3D view-A type and 2D view-A type Click to switch to the full screen screen of 3D image in 3D View-A type, and the full screen screen of 2D image in 2D View-A type. At this time, when switching from 3D view-A type to full-screen enlarged screen, zoom in/out and direction movement are the same with the mouse control of the user command input unit. You can scroll through photos by using the zoom in/out, direction movement, and left and right arrow buttons on the keyboard.

When the x icon is clicked on the A-type full screen screen, it is converted to the 3D view-A type previously viewed. This means that, from the user's point of view, the 3D view is the basic usage, and the user briefly refers to the 2D picture from the angle.

Also, FIG. 10 is an exemplary view showing a 3D view-A type screen configuration in 3D dual mode of the face analysis system according to an embodiment of the present invention, and FIG. 11 is a 2D view in 3D dual mode - It is an exemplary view showing a screen configuration of type A, and FIG. 12 is an exemplary view showing a full screen screen of type B in 3D dual mode of the face analysis system.

As shown in the figure, in the 3D dual mode, the 3D view-B type displays only the 3D face image in both the left half of the third area and the remaining right area. In addition, 2D thumbnails are provided in the form of a bar at the lower end of the third region.

In this case, the first of the 2D thumbnail images is based on the date selected in the first face image loading step. Also, at this time, each thumbnail is assigned an individual number (30) for an individual image, providing a means for calling a specific picture, such as "Let's see a few pictures," when discussing with others from the user's point of view.

In other words, the 3D view-B type of 3D dual mode loads two different 3D images, and changes the direction, enlarges/reduces, and moves the left (red) cross-shaped 3D image at any point to the right. It provides the ability to synchronize 3D images and move them together.

Since the 3D images shown in the 3D view-B type are different 3D images, synchronization may not be complete. can do.

In the 3D view-B type, the direction, enlargement/reduction, and movement control method by the mouse or keyboard of the user command input unit is the same as that of the 3D view-A type, and at the time of initial loading, properties such as a specific direction and enlarged state and horizontal It has a vertical and 3:4 size ratio.

In the 3D view-B type, a 2D view-B type in which two different 2D images are respectively loaded in the third area by selecting different 2D thumbnail images from the 2D thumbnail images provided at the bottom can be provided. have.

This is to compare the before and after format through different 2D images. In this case, the control method is the same as in the 3D view-B type, but in the case of 2D, you can use the left and right arrow buttons on the keyboard to flip through photos. In addition, it is possible to provide a function to move only the 2D image checked with V through the sync check button 40 at the bottom left of the screen, or to synchronize both 2D images and move them together.

In the 3D view-B type and 2D view-B type, if the full-screen zoom icon a is clicked, the 3D dual mode image displayed in the third area of the 3D view-B type or 2D view-B type is displayed in full screen. converted to the screen. In this case, user control after full screen deployment is the same as in 3D Single mode.

As described above, in the screen display control method of the database-linked face analysis system of the present invention, in the 3D single mode, the 3D image or the 2D image is displayed in the left area of the third area, and in the right area, the 2D thumbnail ( thumbnail), and in the 3D Dual mode, it is possible to effectively analyze two images in the third area by composing a screen showing different 3D images or 2D images in the left area of the third area. to provide so that

In addition, in 3D Dual mode, a sync check button 40 is provided at the bottom left of the screen that can be synchronized to move the other image while controlling the lower image through synchronization of two different images. have.

As described above, in the detailed description of the present invention, preferred embodiments have been described, but those of ordinary skill in the art will not depart from the spirit and scope of the present invention as set forth in the following claims. It will be understood that various modifications and variations of the present invention can be made.

100: face analysis system 110: image acquisition unit
120: screen display unit 130: control unit
140: command input unit 150: storage unit
200: database (DB)

Claims (10)

In the face analysis system,
An image acquisition unit that loads a face image in conjunction with a network-based database (DB) that classifies and stores a plurality of 3D and 2D-based face images according to a corresponding list;
a screen display unit for displaying the face image loaded in the image acquisition unit based on a browser having one or more user interface (UI) areas; and
Database interworking 3D, characterized in that it comprises a control unit that receives a user screen control command as an input and controls the user interface (UI) of the screen display unit to analyze the face image while changing one or more view modes face analysis system.
The method according to claim 1,
The database linkage 3D face analysis system, characterized in that the list of the database (DB) is a list that is divided into the owner name, gender, date of birth, and shooting date of the face image, and stores the face images for each group according to the list .
The method according to claim 1,
The database (DB) is an open source-based relational database management system (RDBMS), which is based on either PostgreSQL or MariaDB.
The method according to claim 1,
The browser of the screen display unit
A first area that is fixed in the form of a horizontal bar at the top and provides one or more menus displayed as icons;
A second area that provides a menu to select a view mode and detailed information of a face image uploaded to a certain area on the left; and
A database-linked 3D face analysis system, characterized in that it is configured to be divided into a third area that expresses a face image according to a view mode as a certain area on the right side.
5. The method according to claim 4,
The view mode is divided into 3D single mode or 3D dual mode,
The 3D single mode is an area in which the left half of the third area displays a face image, and provides a screen in which 2D thumbnail photos with individual numbers are listed in the remaining right area,
The 3D dual mode displays different face images in the left half of the third area and the other right area, and 2D thumbnail photos with individual numbers are provided in a bar form at the bottom. A database-linked 3D face analysis system.
6. The method of claim 5,
In the 3D dual mode, if the direction is changed, enlarged/reduced, or moved to any point of any one face image according to a user screen control command with respect to two different face images expressed in the third area, A database-linked 3D face analysis system, characterized in that it provides a function in which the face image of the other side is synchronized and moved together.
A method for controlling screen display of a database-linked 3D face analysis system, the method comprising:
Logging into the system through user authentication to access the face analysis system;
A step of displaying a browser consisting of a user interface (UI) divided into one or more areas;
loading the face image and information on the image stored in the database onto the browser;
and analyzing the face image while changing a view mode through a user screen control command.
8. The method of claim 7,
The system login step includes inputting a license ID value and a user password of the face analysis system to confirm user authentication.
8. The method of claim 7,
The view mode in the step of analyzing the face image is divided into a 3D single mode or a 3D dual mode,
The 3D single mode is an area in which the left half of the third area displays a face image, and provides a screen in which 2D thumbnail photos with individual numbers are listed in the remaining right area,
The 3D dual mode displays different face images in the left half of the third area and the other right area, and 2D thumbnail photos with individual numbers are provided in a bar form at the bottom. How to control the screen display of a face analysis system.
10. The method of claim 9,
In the 3D dual mode, when the direction is changed, enlarged/reduced, or moved to any point of any one face image according to a user screen control command for two different face images expressed in the third area, A method for controlling the screen display of a face analysis system, characterized in that it provides a function of synchronizing and moving the face image of the other side.

Images