KR102111808B1 - Personalized user experience profiling system and method applying thereto - Google Patents

Abstract

A personalized UX profiling system and a personalized UX profiling method applied thereto are provided. According to the personalized UX profiling system, a motion recognition unit that recognizes user's motion information, a physiological signal measurement unit that measures user's physiological signal information, a display unit that displays image information to a user, and operation information, physiological signal information, and By matching the video information, it is possible to include a database unit that stores personalized user UX (User eXperience) information for the user, so that service prototyping can be implemented by simulation evaluation and can be implemented by utilizing various indicators.

Description

Personalized UX profiling system and personalized UX profiling method applied thereto {Personalized user experience profiling system and method applying additional}

The present invention relates to a personalized UX profiling system and a personalized UX profiling method applied thereto, and more particularly, to a personalized UX profiling system and a personalized UX profiling method applied thereto to provide a personalized service for a user will be.

Prototyping is a system development technique that is taken to enhance the effectiveness of communication between developers and users. It should be borne in mind that the important thing when performing a prototyping technique is for mutual understanding and knowledge exchange between developers and users. If you take a general analysis method, you can create a communication tool called a prototype because it can bring different understandings between them.

Prototyping can take many forms depending on its purpose. First, if only the user's needs are analyzed, a prototype for disposal can be created. Second, there is a quick and dirty prototype developed using 4GL. Third, after completing the detailed design and implementation, there may be a prototype developed for testing prior to mass production. Fourth, there are prototypes that show examples of input / output but do not have actual data and do not implement procedural logic. Finally, there are evolved prototypes that evolve into the final system by continuously evolving the developed prototype.

The prototype analyzes the user's needs at each stage and repeats the prototyping, ignoring the traditional life cycle. In the end, the true prototype should be the evolutionary prototype. In particular, when developing with RAD technique, it is important to know that each stage of the prototype must lead to the actual system.

As such, service prototyping is the overall process of test verification before any service is implemented. To this end, a method of applying to a real service by reflecting the user's evaluation after adopting a user's random use is adopted. However, the existing service prototyping method has a disadvantage in that it costs a lot of time and time because a prototype is reflected in the service.

Therefore, it is required to find a method for providing service prototyping more simply.

The present invention was devised to solve the above problems, and an object of the present invention is a personalized UX profiling system that stores personalized UX information for a user by matching user's motion information with physiological signals and image information, and It is to provide a personalized UX profiling method applied to this.

According to an embodiment of the present invention for achieving the above object, the personalized UX profiling system, a motion recognition unit for recognizing the user's motion information; A physiological signal measurement unit for measuring user physiological signal information; A display unit that displays image information to a user; And a database unit storing personalized UX (User eXperience) information for the user by matching the operation information, physiological signal information, and image information.

In addition, the display unit displays image information on a specific service, and the motion recognition unit recognizes a user's operation information on a specific service, and uses the physiological signal information to obtain user satisfaction information on the specific service. It may further include a control unit for determining.

Also, the display unit may display 3D image information.

In addition, the physiological signal measurement unit may generate the user's emotional information using the measured physiological signal information.

In addition, the motion recognition unit may extract the user's joint information and recognize the user's location information and motion information using the extracted joint information.

On the other hand, according to an embodiment of the present invention, a personalized UX profiling method using a personalized UX profiling system includes: a motion recognition step of recognizing user's motion information; A physiological signal measuring step of measuring user physiological signal information; A display step of displaying image information to a user; And matching the operation information, physiological signal information, and image information to store personalized user eXperience (UX) information for the user.

According to various embodiments of the present invention, it is possible to store personalized UX information for a user by matching the user's motion information with physiological signals and image information, so that service prototyping can be implemented through simulation evaluation and various indicators It can be implemented by utilizing.

1 is a diagram showing the structure of a personalized UX profiling system according to an embodiment of the present invention;
2 is a flow chart provided to explain a personalized UX profiling method according to an embodiment of the present invention,
3 is a diagram illustrating a personalized UX profiling sequence according to an embodiment of the present invention;
4 is a diagram showing a transmitter structure for experiment start signal information according to an embodiment of the present invention;
5 is a diagram showing a client structure for ready signal information, according to an embodiment of the present invention;
6 is a diagram illustrating an experiment start screen among display screens from a user's point of view according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating a screen displaying a forward movement phrase among display screens from a user's point of view according to an embodiment of the present invention;
FIG. 8 is a view showing a screen displaying the phrase stop in place on a display screen at a user's point of view according to an embodiment of the present invention;
9 is a diagram illustrating a screen displaying a phrase to select among display screens from a user's point of view according to an embodiment of the present invention;
10 is a diagram illustrating a first task screen among display screens of a user's viewpoint according to an embodiment of the present invention;
11 is a view showing a second task screen among display screens from a user's point of view according to an embodiment of the present invention;
12 is a view showing a third task screen among display screens from a user's point of view according to an embodiment of the present invention;
13 is a diagram showing packet transmission information according to an embodiment of the present invention;
14 is a diagram showing data information to be transmitted, according to an embodiment of the present invention;
15 is a diagram showing a client structure for task start and end information, according to an embodiment of the present invention;
16 is a diagram illustrating a client screen for task start and end information according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

1 is a diagram illustrating a structure of a personalized UX profiling system 100 according to an embodiment of the present invention. As shown in FIG. 1, the personalized UX profiling system 100 includes a display unit 110, a physiological signal measurement unit 120, a motion recognition unit 130, a database 140, and a control unit 150. .

The display 110 visually displays image information to the user. At this time, the display 110 may be a device that displays 3D image information, and as shown in FIG. 1, “Oculus” is an example of a device that displays a 3D image. Also, the display 110 may display a 3D image for a specific service.

The physiological signal measuring unit 120 measures the user's physiological signal information. The physiological signal measuring unit 120 may generate the user's emotional information by using the measured physiological signal information, for example, the physiological signal measuring unit 120 is emotional information on whether the user's emotion is satisfactory or unsatisfactory. It can be generated based on the physiological signal information. As shown in FIG. 1, the physiological signal measurement unit 120 may measure an autonomic nervous system (pulse, body temperature, skin conductivity) among bio signals using the LabVIEW language.

The motion recognition unit 130 recognizes the user's motion information. Specifically, the motion recognition unit 130 may extract the user's joint information and recognize the user's location information and motion information using the extracted joint information. The motion recognition unit 130 is a module for measuring the user's position and hand motion pattern information.It uses Visual studio 2010 and extracts the joint information of the user using the C ++ language and Kinect SDK, and uses the extracted information to locate the user. It can be applied to identification and gesture recognition.

The database unit 140 stores personalized UX (User eXperience) information for the user by matching motion information, physiological signal information, and image information over time. Through this, the database unit 140 may store personalized UX information for each user.

Then, in the process of prototyping for a specific service, the display 110 displays video information for a specific service, and the motion recognition unit 130 recognizes the user's motion information for the specific service, and the controller 150 determines user satisfaction information for a specific service using physiological signal information.

Through this, the personalized UX profiling system 100 can check information about the user's UX in order to prototype for a specific service using various information.

Each component of the personalized UX profiling system 100 is required to work in conjunction for synchronization of data transmission for each module. Accordingly, UDP is used for data transmission in one PC, and the transmitter and the client are different depending on the progress of each process.

2 is a flowchart provided to describe a personalized UX profiling method according to an embodiment of the present invention.

The personalized UX profiling system 100 first defines a service profiling component (S210). Then, the personalized UX profiling system 100 creates a service profiling structure based on user experience (S220). Thereafter, the personalized UX profiling system 100 profiles the UX (S230).

To this end, the personalized UX profiling system 100 profiles the UX profiling integrated module by reflecting the sensory elements for extracting the UX-based interaction experience characteristics (S240). In addition, the personalized UX profiling system 100 extracts the UX-based interaction experience characteristics and database them, and extracts the user's sense, cognition, and movement characteristics in the service task presented by the service through repetitive experiments ( S250).

Then, the personalized UX profiling system 100 performs virtual personalization for each expected consumer based on UX profiling (S260). In addition, the personalized UX profiling system 100 stores XML-based UX profiling in a database (S265) and generates user profiling-based ISPA software (S270).

Through this process, the personalized UX profiling system 100 provides a personalized UX profiling method.

In addition, the personalized UX profiling system 100 recognizes the user's motion information, measures the user's physiological signal information, displays image information to the user, matches the motion information, physiological signal information, and image information to the user By storing personalized user UX (User eXperience) information, a personalized UX profiling method may be provided.

Hereinafter, the process of personalized UX profiling, protocol protocol, and the like will be described in detail. 3 is a diagram illustrating a personalized UX profiling sequence according to an embodiment of the present invention. The data protocol protocol and development method for interworking by process shown in FIG. 3 are defined as follows.

① Experiment start signal information (LabVIEW module → Oculus Rift module)

* Data protocol protocol

-When the 3-minute reference measurement is over: “start” string information is transmitted to the Oculus Rift module.

* UDP Sender in LabVIEW environment

-Interworking with Oculus Rift module that provides 3D user view for UX profiling

-Open port numbers 9901 and 9902, and connect IP address to 127.0.0.1

-Refer to Figure 4 for the structure of the UDP Sender, Figure 4 is a diagram showing a transmitter structure for the experiment start signal information, according to an embodiment of the present invention.

* UDP Client in Unity3D environment

-Create client with assigned port number

-IPEndPoint creation. All incoming IPs are allowed without restriction

-Receive to the created client (ie ip is the above IPEndPoint, port is the port specified when creating the client)

-Encoding received byte data as utf8 string

[receive thread, udp client creation and port assignment]

[receive thread activation]

[Receive thread function]

② Preparation signal information (Oculus Rift module → Biomeasurement (LabVIEW) module)

* Data protocol protocol

-Oculus Rift module sends “imstart” string information

* UDP Sender in Unity3D environment

-ip, port, IPEndPoint, UdpClinet declaration

-Port is assigned as 3363

-IPEndPoint creation and send client creation

-Encode the message in UTF8 format and send it to the generated client

[declaration of ip, port, IPEndPoint, UdpClinet]

[port assigned to 3363]

[Create IPEndPoint and create send client]

[Send signal screen after encoding in UTF8 format]

* UDP Client in LabVIEW environment

-When “imstart” comes in among the data coming from 3363 port from the same IP, it is implemented to switch to the standby state of physiological signal measurement.

-Referring to FIG. 5 for the structure of the client, and FIG. 5 is a diagram illustrating a client structure for ready signal information according to an embodiment of the present invention

③⑥⑨⑬ Oculus Rift module → User

* Provide visual information

-A phrase informing the start of the experiment, see FIG. 6, and FIG. 6 is a diagram showing an experiment start screen among display screens from a user's viewpoint according to an embodiment of the present invention

-A phrase to move forward, see FIG. 7, and FIG. 7 is a diagram showing a screen displaying a move phrase in a display screen at a user's point of view, according to an embodiment of the present invention,

-A phrase to stop in place, see FIG. 8, and FIG. 8 is a diagram illustrating a screen displaying a phrase to stop in a place among display screens of a user's viewpoint according to an embodiment of the present invention

-A phrase to select, see FIG. 9, FIG. 9 is a diagram showing a screen displaying a phrase to select among display screens at a user's point of view, according to an embodiment of the present invention,

-Screen example for each task

10 is a diagram illustrating a first task screen among display screens of a user's viewpoint according to an embodiment of the present invention;

11 is a view showing a second task screen among display screens from a user's point of view according to an embodiment of the present invention;

12 is a view showing a third task screen among display screens from a user's point of view according to an embodiment of the present invention;

④⑦⑩⑭User → Kinect module

* Kinect motion recognition module processes conscious actions by the user's visual and auditory stimuli.

⑤⑧⑪⑮ Kinect module → Oculus Rift module

* Data protocol protocol

-UDP communication is used, IP is localhost (127.0.0.1), and port number is 9900.

-Network BYTE Order: Big Endian

-Packet data type: char type transmission

-Packet Size: 10byte x 10 = 100byte

※ Allow additional packet size for sending and receiving data.

* UDP Sender in Kinect for Windows environment

-Packet transmission information, see FIG. 13, FIG. 13 is a diagram showing packet transmission information according to an embodiment of the present invention

Ⓐ Packet Index: Start of Packet-> Fixed as '1'

Ⓑ Sending / Receiving Index: '1' for transmission, and '2' for reception (currently use only transmission-> fixed as '1')

b-1. Transmission Data: See FIG. 14, FIG. 14 is a diagram showing data information to be transmitted according to an embodiment of the present invention,

Ⓒ Receiving Data: Data to receive from Unity (not currently used-> fixed as '0')

Ⓓ Scene Number: Content screen number to be received from Unity

(Not currently used-> fixed as '0')

Ⓔ Z-coordinate: The Z-coordinate of the subject's head, which represents the user's location. Send to Unity

* UDP Client in Unity3D environment

-Create receive thread, client, port

-Thread start

-Port assignment to Client

-IPEndPoint creation

-String encoding the received byte data in UTF8 format

[receive thread, client, port creation]

[Start Thread]

[Contents of client development for user location and hand gesture information]

⑫, 16,17 Task start and end information (Oculus Rift module → Biomeasurement (LabVIEW) module)

* Data protocol protocol

-When task is first started: Start_Tag (0) + start time information (HHMMSS, hour: minute: second)

-When task ends: Start_Tag (5) + start time information (HHMMSS, hour: minute: second) + time taken (MMSS, minute: second)

* UDP Sender in Unity3D environment

-Send with tag number, start point information (hour, minute, second), and time information (minute, second)

[Contents of Sender development for task start and end information]

* UDP Client in LabVIEW environment

-As start information of Task 1, Start Tag enters 0, and the moment it recognizes as Task 1, it starts to measure the physiological signal.

-When the Start Tag of Task2 is 1, the physiological signal of Task1 stops the measurement, the data is stored and analyzed, and the physiological signal of Task2 starts to be measured. Repeated like this.

-Lastly, when Task5's Start Tag 4 comes in, it goes the same way, but when Start Tag 5 comes in, the measurement of the physiological signal of Task5 stops and the program ends.

-Task number, time information, and duration information for each task are all saved in Excel format.

-For the client structure and screen for task start and end information, see FIGS. 15 and 16, and FIG. 15 is a diagram showing a client structure for task start and end information according to an embodiment of the present invention, and FIG. This is a diagram showing a client screen for task start and end information according to an embodiment of the present invention.

So far, the process of personalized UX profiling, protocol protocols, and the like have been described in detail.

Through this personalized UX profiling method, you can quickly and easily evaluate and compare the service with the Quick & Dirty method. As a simulation evaluation indicator, you can use various indicators in addition to the time value, and apply these indicators to other service evaluations. There will be.

On the other hand, of course, the technical idea of the present invention can be applied to a computer-readable recording medium containing a computer program for performing functions and methods of the system according to the present embodiment. Further, the technical idea according to various embodiments of the present disclosure may be implemented in the form of computer-readable programming language codes recorded on a computer-readable recording medium. The computer-readable recording medium can be any data storage device that can be read by a computer and stores data. Of course, the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, flash memory, solid state disk (SSD), or the like. In addition, computer-readable codes or programs stored on a computer-readable recording medium may be transmitted through a network connected between computers.

In addition, although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

100: personalized UX profiling system
110: display unit
120: physiological signal measurement unit
130: motion recognition unit
140: database
150: control unit

Claims (6)

A motion recognition unit for recognizing user motion information;
A physiological signal measurement unit for measuring user physiological signal information;
A display unit that displays image information to a user; And
It includes; a database unit for storing the personalized UX (User eXperience) information for the user by matching the operation information, physiological signal information and image information;
The display unit,
Display personalized UXs for prototyping specific services as video information,
The motion recognition unit,
Recognizes the user's motion information for personalized UXs,
In the process of prototyping for the specific service, a control unit for determining user satisfaction information for the specific service prototyping using the physiological signal information;
In the prototyping process for the specific service,
When the physiological signal measurement unit transmits an experiment start signal to the display unit, the display unit transmits a preparation signal to the physiological signal measurement unit,
The display unit provides the user with an experiment start guide phrase and task screens,
The motion recognition unit transmits the user's location information and motion information to the display unit,
The display unit transmits a task start signal and an end signal to the physiological signal measurement unit,
The physiological signal measuring unit is a personalized UX profiling system, characterized in that for measuring the physiological signal of the user for each task, based on the task start signal and the end signal. delete According to claim 1,
The display unit,
A personalized UX profiling system characterized by displaying 3D image information. According to claim 1,
The physiological signal measuring unit,
Personalized UX profiling system, characterized in that for generating the user's emotional information using the measured physiological signal information. According to claim 1,
The motion recognition unit,
Personalized UX profiling system characterized by extracting the user's joint information and recognizing the user's location information and motion information using the extracted joint information. In the personalized UX profiling method by the personalized UX profiling system,
A motion recognition step in which the motion recognition unit of the personalized UX profiling system recognizes motion information of the user;
The physiological signal measuring unit of the personalized UX profiling system, the physiological signal measuring step of measuring the user's physiological signal information;
The display unit of the personalized UX profiling system, a display step of displaying image information to the user; And
Including the database unit of the personalized UX profiling system, matching the motion information, physiological signal information and image information to store personalized UX (User eXperience) information for the user;
The display step,
Display personalized UXs for prototyping specific services as video information,
The storing step,
Recognizes the user's motion information for personalized UXs,
The personalized UX profiling method,
The control unit of the personalized UX profiling system, in the prototyping process for the specific service, prototyping the user's satisfaction information for the specific service using the physiological signal information to determine; further comprising,
In the prototyping process for the specific service,
When the physiological signal measurement unit transmits an experiment start signal to the display unit, the display unit transmits a preparation signal to the physiological signal measurement unit,
The display unit provides the user with an experiment start guide phrase and task screens,
The motion recognition unit transmits the user's location information and motion information to the display unit,
The display unit transmits a task start signal and an end signal to the physiological signal measurement unit,
The physiological signal measuring unit personalized UX profiling method, characterized in that for measuring the physiological signal of the user for each task, based on the task start signal and the end signal.

Images