WO2024135932A1

WO2024135932A1 - Operation method of electronic device for providing information, and electronic device supporting same

Info

Publication number: WO2024135932A1
Application number: PCT/KR2023/001672
Authority: WO
Inventors: 잉제무
Original assignee: 쿠팡 주식회사
Priority date: 2022-12-19
Filing date: 2023-02-06
Publication date: 2024-06-27
Also published as: KR102618518B1; KR20240096422A

Abstract

The present disclosure provides a method for providing information by an electronic device, the method comprising the steps of: identifying, on a test management page that manages an A/B test for a service provided by the electronic device, information about a first user of the service to which the A/B test is to be applied; identifying information about a first test group including one or more A/B tests and configured corresponding to the first user; and on the basis of a first input in which an option value for each of A/B tests included in the first test group is configured, providing test result information identified corresponding to the first user on the service.

Description

Method of operating an electronic device that provides information and electronic devices that support it

The present invention relates to a method and device for providing information, and more specifically, to a method and electronic device for providing test result information in which an electronic device applies one or more A/B tests set for users on a service. .

With the development of electronic technology, e-commerce has become a field of shopping. Customers can purchase items online without having to go to a shopping mall or market in person, and items purchased online are delivered to the delivery address requested by the customer.

In the case of e-commerce, the processing of detailed and accurate information about products has a significant impact on service satisfaction, so discussions are taking place on various methods to process information in more detail and accurately.

In relation to this, prior literature such as KR101756594B1 or KR101500849B1 may be referred to.

According to the method of the present invention, an electronic device can provide test result information by applying one or more A/B tests set for users on a service.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

Various embodiments may provide a method of operating an electronic device to provide information and an electronic device that supports the same.

In a method of providing information by an electronic device according to various embodiments, on a test management page that manages A/B testing for a service provided by the electronic device, the first user of the service to which the A/B test is to be applied Confirming information about; Confirming information about a first test group including one or more A/B tests set corresponding to the first user; And based on a first input that sets option values for each A/B test included in the first test group, providing test result information confirmed corresponding to the first user on the service. You can.

In an exemplary embodiment, confirming information about the first user includes obtaining a second input for selecting the first user from among a plurality of users managed to apply A/B testing for the service. ; and confirming information about the first user in response to the second input.

In an exemplary embodiment, the first user is specified based on first identification information identifying the service account of the first user, and the information about the first user may include the first identification information.

In an exemplary embodiment, setting the error occurrence information may include setting a message notifying missing data call when the specific error type corresponds to the first error type.

In an exemplary embodiment, when a first A/B test in which an option value is set to be applied according to identification information for a service account is included in the first test group, the first A/B test identifies the first The first option value corresponding to the information may be set as the default value.

In an exemplary embodiment, the first user is specified based on second identification information that identifies the user terminal of the first user, and the information about the first user may include the second identification information.

In an exemplary embodiment, when a second A/B test set to apply an option value according to identification information about the user terminal is included in the first test group, the second identification in the second A/B test The second option value corresponding to the information may be set as the default value.

In an exemplary embodiment, the information about each A/B test included in the first test group includes: information about the test identification number of each A/B test, information about the name of each A/B test, It may include information about one or more option values that can be set in each A/B test, information about the target type of each A/B test, and information about the platform to which each A/B test is applied. .

In an exemplary embodiment, the first test group is included in a plurality of test groups set to correspond to the first user, and the step of checking information about the first test group includes information about the first user. Confirming information about the plurality of test groups based on the information; and confirming information about the first test group based on a third input for selecting the first test group among the plurality of test groups.

In an exemplary embodiment, the first test group may be set to store a state in which each A/B test included in the first test group is applied as a certain option value according to the first input.

In an exemplary embodiment, the information about the first test group includes information about one or more test state setting sets included in the first test group, and the first test included in the one or more test state setting sets The state setting set stores the first test group in a state in which each A/B test included in the first test group is applied with a certain option value, and the fourth input to the first test state setting set is If present, it can be set so that information about the first test group can be confirmed as a stored state corresponding to the first test state setting set.

In an exemplary embodiment, the first test group is set to correspond to a specific service topic for the service, and information about the first test group may include information about the specific service topic.

In an exemplary embodiment, the information providing method includes first activation information activating whether to apply the A/B test to the first user and second activation information activating whether to set the first test group. It may further include the step of providing, and the first test group may be set based on a fifth input corresponding to the first activation information and a sixth input corresponding to the second activation information.

In an exemplary embodiment, the information providing method may further include providing information on the first test group to one or more test managers who manage the A/B test for the first user.

In an exemplary embodiment, each A/B test included in the first test group may be managed in advance so that there is no conflict between them in the first test group.

An electronic device that provides information according to various embodiments includes: a processor; and one or more memories storing one or more instructions, wherein the one or more instructions, when executed, cause the processor to: manage A/B testing for services provided by the electronic device. On the test management page, confirming information about the first user of the service to which A/B testing will be applied; Confirming information about a first test group including one or more A/B tests set corresponding to the first user; And performing a step of providing test result information confirmed corresponding to the first user on the service based on a first input that sets an option value for each A/B test included in the first test group. The processor can be controlled.

The various embodiments of the present disclosure described above are only some of the preferred embodiments of the present disclosure, and various embodiments reflecting the technical features of the various embodiments of the present disclosure can be understood by those skilled in the art. It can be derived and understood based on the detailed description described below.

The present invention presents a method for an electronic device to provide test result information by applying one or more A/B tests set for users on a service, and has a technical effect in terms of facilitating the administrator's testing of the service. have

The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

FIG. 1 is a diagram illustrating an information provision system in which a method of operating an electronic device for providing information according to various embodiments can be implemented.

FIG. 2 is a diagram illustrating the configuration of a server device 100 and a user device 200 according to various embodiments.

FIG. 3 is a diagram illustrating a method of operating the server device 100 for providing information according to various embodiments.

Figures 4 and 5 are diagrams illustrating an example of managing A/B testing for a user based on identification information that can specify the user.

Figure 6 is a diagram illustrating an example of setting to store the state in which each A/B test included in a test group is applied with a certain option value.

FIG. 7 is a diagram illustrating an example of setting a state setting set corresponding to a test group to store a state in which each A/B test included in the test group is applied with a certain option value.

FIG. 8 is a diagram illustrating an example of setting a test group based on an input activating whether an A/B test can be applied to a user and an input activating whether a test group set for a user can be set.

The following embodiments combine components and features of various embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. Additionally, various embodiments may be configured by combining some components and features. The order of operations described in various embodiments may change. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments.

In the description of the drawings, procedures or steps that may obscure the gist of the various embodiments are not described, and procedures or steps that can be understood at the level of a person with ordinary knowledge in the relevant technical field are not described. did.

Throughout the specification, when a part is said to “comprise or include” a certain element, this means that it does not exclude other elements but may further include other elements, unless specifically stated to the contrary. do. In addition, terms such as "... unit", "... unit", and "module" used in the specification refer to a unit that processes at least one function or operation, which refers to hardware, software, or a combination of hardware and software. It can be implemented as: Additionally, the terms “a or an,” “one,” “the,” and similar related terms are used herein in the context of describing various embodiments (particularly in the context of the claims below). Unless otherwise indicated or clearly contradicted by context, it may be used in both singular and plural terms.

Hereinafter, preferred embodiments according to various embodiments will be described in detail with reference to the attached drawings. The detailed description set forth below in conjunction with the accompanying drawings is intended to illustrate exemplary embodiments of various embodiments and is not intended to represent the only embodiment.

In addition, specific terms used in various embodiments are provided to aid understanding of the various embodiments, and the use of such specific terms may be changed to other forms without departing from the technical spirit of the various embodiments. .

Referring to FIG. 1, information providing systems according to various embodiments may be implemented in various types of electronic devices. For example, the information provision system may be implemented in the server device 100 and the user device 200. In other words, the server device 100 and the user device 200 may perform operations according to various embodiments of the present disclosure based on the information provision system implemented in each device. Meanwhile, the information provision system according to various embodiments is not limited to what is shown in FIG. 1, and may be implemented in a wider variety of electronic devices and servers.

The server device 100 according to various embodiments may be a device that performs wireless and wired communication with a plurality of user devices 200 and includes storage with a large storage capacity. For example, the server device 100 may be a cloud device that works with a plurality of user devices 200.

The user device 200 according to various embodiments may be a device that can be used by an individual user, such as a desktop PC, tablet PC, or mobile terminal. In addition, other electronic devices that perform similar functions may be used as the user device 200.

An information provision system according to various embodiments may include various modules for operation. Modules included in the information provision system are implemented so that the physical device (e.g., server device 100 and user device 200) on which the information provision system is implemented (or included in the physical device) can perform specified operations. It may be computer code or one or more instructions. In other words, the physical device in which the information provision system is implemented stores a plurality of modules in the memory in the form of computer code, and when the plurality of modules stored in the memory are executed, the plurality of modules are designated by the physical device corresponding to the plurality of modules. Actions can be performed.

Referring to FIG. 2 , the server device 100 and the user device 200 may include an input/output unit 210, a communication unit 220, a storage 230, and a processor 240.

The input/output unit 210 may be various interfaces or connection ports that receive user input or output information to the user. The input/output unit 210 may include an input module and an output module, and the input module receives user input from the user. User input can take various forms, including key input, touch input, and voice input. Examples of input modules that can receive such user input include traditional keypads, keyboards, and mice, as well as touch sensors that detect the user's touch, microphones that receive voice signals, cameras that recognize gestures through image recognition, etc. A proximity sensor including at least one of an illumination sensor or an infrared sensor that detects user approach, a motion sensor that recognizes user movement through an acceleration sensor or gyro sensor, and various other types of sensors that detect or receive user input. There is an input means, and the input module according to an embodiment of the present disclosure may include at least one of the devices listed above. Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor that detects touch through a touch panel or touch film attached to the display panel, or an optical touch sensor that detects touch by an optical method. In addition, the input module may be implemented in the form of an input interface (USB port, PS/2 port, etc.) that connects an external input device that receives user input instead of a device that detects user input itself. Additionally, the output module can output various information. The output module may include at least one of a display that outputs an image, a speaker that outputs sound, a haptic device that generates vibration, and other various types of output means. In addition, the output module may be implemented in the form of a port-type output interface that connects the individual output means described above.

As an example, a display-type output module can display text, still images, and moving images. Displays include liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, flat panel display (FPD), and transparent display. Among various types of devices that can perform image output functions such as display, curved display, flexible display, 3D display, holographic display, projector, and other It can contain at least one. This display may be in the form of a touch display integrated with the touch sensor of the input module.

The communication unit 220 can communicate with other devices. Accordingly, the server device 100 and the user device 200 can transmit and receive information with other devices through the communication unit. For example, the server device 100 and the user device 200 may communicate with each other or with other devices using a communication unit.

Here, communication, that is, transmission and reception of data, can be accomplished wired or wirelessly. For this purpose, the communication department includes a wired communication module that connects to the Internet through a LAN (Local Area Network), a mobile communication module that transmits and receives data by connecting to a mobile communication network through a mobile communication base station, and a WLAN (Wireless Local Area Network) such as Wi-Fi. A short-distance communication module using an Area Network-type communication method or a WPAN (Wireless Personal Area Network)-type communication method such as Bluetooth or Zigbee, and a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System) ) may include a satellite communication module using a satellite communication module or a combination thereof.

Storage 230 can store various types of information. Storage 230 may store data temporarily or semi-permanently. For example, the storage 230 of the server device 100 contains an operating program (OS: Operating System) for running the server device 100, a program for generating data or Braille for hosting a website, or an application (e.g. For example, data related to a web application) may be stored. Additionally, the storage 230 may store modules in the form of computer code as described above.

Examples of storage 230 include hard disk drive (HDD), solid state drive (SSD), flash memory, read-only memory (ROM), random access memory (RAM), etc. This can be. This storage 230 may be provided as a built-in type or a detachable type.

The processor 240 controls the overall operation of the server device 100 and the user device 200. To this end, the processor 240 can perform calculations and processing of various information and control the operation of components of the server device 100. For example, the processor 240 may execute a program or application to provide information. The processor 240 may be implemented as a computer or similar device using hardware, software, or a combination thereof. In hardware, the processor 240 may be implemented in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, it may be implemented in the form of a program that drives the hardware processor 240. Meanwhile, unless otherwise specified in the following description, the operations of the server device 100 and the user device 200 may be interpreted as being performed under the control of the processor 240. That is, when modules implemented in the above-described information provision system are executed, the modules may be interpreted as the processor 240 controlling the server device 100 and the user device 200 to perform the following operations.

In summary, various embodiments may be implemented through various means. For example, various embodiments may be implemented by hardware, firmware, software, or a combination thereof.

In the case of hardware implementation, methods according to various embodiments include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs. It can be implemented by (field programmable gate arrays), processor, controller, microcontroller, microprocessor, etc.

In the case of implementation by firmware or software, methods according to various embodiments may be implemented in the form of modules, procedures, or functions that perform the functions or operations described below. For example, software code can be stored in memory and run by a processor. The memory may be located inside or outside the processor, and may exchange data with the processor through various known means.

Below, various embodiments will be described in more detail based on the above technical idea. The contents described above may be applied to various embodiments described below. For example, operations, functions, terms, etc. that are not defined in various embodiments described below may be performed and explained based on the contents described above.

In the following description, various embodiments will be described on the premise that the electronic device performs an information provision operation.

According to FIG. 3, the server device 100 provides test result information corresponding to the A/B test set for the user, and manages the A/B test for the service to perform the operation of providing test result information. On the test management page, information about the first user of the service to which the A/B test is to be applied is confirmed (301), and information about the first test group including one or more A/B tests set in response to the first user Check (303), and based on the first input that sets the option value for each A/B test included in the first test group, test result information confirmed in response to the first user on the service can be provided. There is (305).

According to FIG. 3, the operation of the server device 100 providing test result information may be performed for a service provided by the server device 100 or a service related to the server device 100, and the service is sold in the service. It may correspond to a service that allows multiple users who use the service to order and purchase multiple items. The plurality of items sold in the service are not limited to the type or type of the item and may include various types or types of items registered by the seller to sell the item.

In addition, in FIG. 3, the user whose information the server device 100 checks is a user managed in advance so that A/B testing can be applied, and the server device 100 identifies the user's account or the user's terminal and A/B testing can be applied to users in a specified format, and the user's account or terminal designated for such A/B testing can be shared with various test managers for the service. Test managers who share the user's account or terminal designated for A/B testing apply the A/B test desired by each test manager to the designated user's account or terminal and check the test results in the user's account or terminal. You can test the service by doing this. Here, A/B testing may refer to a testing method that determines the results and effects by applying and comparing two or more content/versions to specific sub-services or functions of the service, and may be split testing and/or bucket testing. It can also be understood as

According to various embodiments, in operation 301, the server device 100 may check information about the first user of the service to which the A/B test is to be applied on a test management page that manages A/B testing for the service. .

For example, operation 301 in which the server device 100 confirms information about the first user includes obtaining an input for selecting the first user from among a plurality of users managed to apply A/B testing for the service, This may correspond to an operation of providing information about the first user selected in response to the obtained input. In other words, in order to apply A/B testing to a service, multiple users can be managed by being identified and designated through an account or terminal. Among the multiple users managed in this way, the test manager selects the first user. When inputting, the server device 100 can check information about the first user.

For example, the first user may be specified based on first identification information that identifies the service account of the first user, and the information about the first user identified by the server device 100 in operation 301 includes the first user. 1 May contain identifying information. In other words, identification information that identifies the first user's service account may be used to manage and identify the first user to whom A/B testing is to be applied. An example of such identification information is the serial number corresponding to the user's service account. There may be a serial number.

For example, the first user may be specified based on second identification information that identifies the user terminal of the first user, and the information about the first user identified by the server device 100 in operation 301 includes the first user. 2 May include identifying information. In other words, identification information that identifies the first user's user terminal may be used to manage and identify the first user to whom A/B testing is to be applied. An example of such identification information is the individual corresponding to the user's user terminal. There may be a terminal identifier (Personal Computer Identifier (PCID)).

In Figure 4, the user managed to apply the A/B test may be specified based on identification information identifying the service account (401), and the test for applying the A/B test to the user corresponding to the service account Once the group is set (403), the test manager can apply each A/B test included in the test group to the user and check the test results in the user's service account.

In Figure 5, the user managed to apply the A/B test may be specified based on identification information identifying the user terminal (501), and a test for applying the A/B test to the user corresponding to the user terminal The group is set (503), and the test manager can apply each A/B test included in the test group to the user and check the test results on the user's user terminal.

According to various embodiments, in operation 303, the server device 100 may check information about the first test group including one or more A/B tests set to correspond to the first user.

For example, the information about the first test group that the server device 100 confirms according to operation 303 may include information about each A/B test included in one or more A/B tests in the first test group. You can. Information about each A/B test includes: 1) information about the test identification number of each A/B test, 2) information about the name of each A/B test, 3) one or more information that can be set in each A/B test. It may include information about option values, 4) information about the type to which each A/B test is applied, and/or 5) information about the platform to which each A/B test is applied.

Here, the test identification number of the A/B test refers to a number given to identify the A/B test, and one or more option values that can be set in the A/B test are multiple content/contents to be compared through the A/B test. It may refer to the value of the option to apply the version. One or more option values that can be set in an A/B test may be in the form of A, B, C, 캜, None, etc., which means content/version (A) corresponding to option A, content/version (A) corresponding to option B ( B), it may mean a value set to apply content/version (C) corresponding to option C, ... or a value set not to apply any content/version (None).

In addition, the type to which A/B testing is applied refers to the type to which the A/B test is applied, such as the type to which the A/B test is applied to service accounts or the type to which the A/B test is applied to user terminals. This may mean specifying whether it is applied as a type. As an example, one A/B test is 1) which content/version is applied only to service accounts for which the ending digit of the service account identification information is an odd number, or 2) which content/version is applied only to service accounts where the ending digit of the service account identification information is an odd number. One content/version is applied to a service account with an odd number and a different content/version is applied to a service account with an even number, or 3) targeting user terminals with an odd number at the end of the identification information for the user terminal. 4) Which content/version is applied to the user terminal whose identification information for the user terminal has an odd number at the end, and a different content/version is applied to the user terminal whose ending digit is an even number? It can be classified into various types depending on its application type, and information about these types can be included in the information about A/B testing.

The platform to which A/B testing is applied may refer to the platform of the device that serves the service to which A/B testing is applied. For example, for smartphones, A/B testing is performed on each version of IOS and/or Android. The platform to which the test is applied can be determined.

For example, a first user is specified based on first identification information that identifies the service account of the first user, and the server device 100 includes the first identification information in the information about the first user identified in operation 301. In the case where an A/B test included in the first test group that the server device 100 checks in accordance with operation 303 corresponds to a test in which an option value is set to be applied according to identification information for the service account. If so, the server device 100 may manage the first option value corresponding to the first identification information to be set as a default value in the corresponding A/B test. As an example, the first A/B test included in the first test group that the server device 100 checks in accordance with operation 303 is specific to a service account where the ending digit of the identification information for the service account is an odd number. In the case of a test in which an option value is set to be applied according to identification information for a service account, such as having a first option value that allows content/version to be applied, if the last digit of the first identification information is an odd number, In the first A/B test, the first option value may be automatically set to a default value in response to the first identification information.

For example, a first user is specified based on second identification information that identifies the user terminal of the first user, and the server device 100 adds the second identification information to the information about the first user identified in operation 301. In the case where an A/B test included in the first test group that the server device 100 checks in accordance with operation 303 corresponds to a test in which an option value is set to be applied according to identification information for the user terminal. If so, the server device 100 may manage the second option value corresponding to the second identification information to be set as a default value in the corresponding A/B test. As an example, the second A/B test included in the first test group that the server device 100 checks in accordance with operation 303 is specific to the user terminal where the ending digit of the identification information for the user terminal is an even number. In the case of a test in which an option value is set to be applied according to identification information about the user terminal, such as having a second option value that allows content/version to be applied, if the last digit of the second identification information is an even number, In the second A/B test, the second option value corresponding to the second identification information may be automatically set as the default value.

For example, the first test group for which the server device 100 checks information according to operation 303 may be included in a plurality of test groups set to correspond to the first user, and the server for checking information about the first test group Operation 303 of the device 100 involves the server device 100 checking information about a plurality of test groups set for the first user based on information about the first user, and selecting a first test group among the plurality of test groups. This may correspond to an operation of checking information about the first test group based on the input of the selected test manager. In other words, multiple test groups can be set for managed users so that A/B testing can be applied, and when the test manager selects the desired test group, the server device 100 can check information about the selected test group. there is.

According to various embodiments, in operation 305, the server device 100 responds to the first user on the service based on a first input that sets an option value for each A/B test included in the first test group. It is possible to provide confirmed test result information.

For example, the test result information provided by the server device 100 according to operation 305 may include information about the results shown on the service by applying each A/B test included in the first test group. The test manager can set option values for each A/B test included in the first test group, have the test group applied to the first user, and obtain results confirmed accordingly. If the test manager wants to apply only some A/B tests included in the test group, set the desired option value for some of the desired A/B tests, set the option value of None for the remaining A/B tests, etc. The test group can be applied to the first user in the following manner.

For example, the first test group is such that each A/B test included in the first test group has a certain option value according to the first input that sets the option value for each A/B test included in the first test group. It can be set to save the applied state. That is, when the option value for each A/B test included in the first test group is set to a constant state according to the first input, the first test group can be managed so that the state can be stored, and based on this, The saved state can be recalled according to convenience.

In FIG. 6, for a test group set for a specific user 601 (603), the state in which each A/B test included in the test group is set to a certain option value (605) is managed to be stored. Can (607). In other words, if the test manager specifies an option value for each A/B test included in the test group and then inputs an input to save the state in which the option value for each A/B test is set, such as 607, then an input is entered, such as 605. Option values specified for each A/B test can be fixed within the test group, and can also be managed to load the saved state as is for future test groups.

For example, the first test group may be managed through a test state setting set corresponding to a subgroup that stores the state in which the option value for each A/B test included in the first test group is applied. In this case, since the first test group includes one or more test state setting sets, information about the first test group may include information about one or more test state setting sets included in the first test group.

The first test state setting set included in one or more test state setting sets for the first test group sets the first test group to a state in which each A/B test included in the first test group is applied with a certain option value. It can be stored, and if there is an input for selecting a first test state setting set among one or more test state setting sets in the information about the first test group, the first test group is saved as a state corresponding to the first test state setting set. Information about can be confirmed.

Similarly, the second test state setting set included in the one or more test state setting sets may store the first test group in a state in which each A/B test included in the first test group is applied with a certain option value. , At this time, the state in which the option value of each A/B test included in the first test group is applied through the second test state setting set may be different from the first test state setting set. Likewise, if there is an input for selecting a second test state setting set among one or more test state setting sets in the information about the first test group, the information for the first test group is stored corresponding to the second test state setting set. Information can be verified.

In FIG. 7, for a test group set for a specific user 701 (703), a state in which each A/B test included in the test group is set to a certain option value (705) is a specific state setting. It can be managed to be stored in the same format as a set (707). In other words, if the test manager specifies an option value for each A/B test included in the test group and then inputs to save the state in which the option value is set as a status setting set, such as 707, each A/B Option values specified for the test can be fixed within the state setting set, and later, the state setting set can be selected from the test group and managed to retrieve the saved state as above.

Depending on how the test manager wants to apply A/B testing, multiple state setting sets may be set for one test group, and the test manager can select the desired state setting set among the multiple state setting sets set for one test group. By selecting , you can load a test group in which the option values of each A/B test are saved corresponding to the selected state setting set.

For example, the first test group is set to correspond to a specific service topic for the service, and the information about the first test group confirmed by the server device 100 according to operation 303 includes information about the specific service topic. It can be included. In other words, one test group may be a group including A/B tests that have a common topic corresponding to a specific sub-service or function on the service. In this case, the test results provided by the server device 100 according to operation 305 Information may also be information identified in response to a specific service topic for the service.

For example, the first test group is the first test group when the activation input for activating whether or not the A/B test is applied to the first user and the activation input for activating whether or not the setting is possible for the first test group are confirmed. It can be set to allow editing, such as adding an A/B test or deleting an A/B test from the first test group. That is, the server device 100 may provide first activation information activating whether to apply the A/B test to the first user and second activation information activating whether to set the A/B test to the first test group. The first test group may be set based on the fact that the input corresponding to the first activation information and the input corresponding to the second activation information are confirmed.

In FIG. 8, for each user identified according to a service account or user terminal (801), first button information that determines whether to allow A/B testing to be applied to each user may be set (803) ), which determines whether to allow setting or editing test groups for management of A/B tests for each user when applying A/B testing for users based on the first button information is activated. Second button information may be set (805).

In Figure 8, it is shown that when the first button information is activated, it may be allowed to apply an A/B test for the user, and when the second button information is deactivated, it may be allowed to set or manage a test group for the user. However, the present invention is not limited to this, and for example, unlike FIG. 8, when the second button information is activated, it may be set to allow setting or managing a test group for the user.

For example, in accordance with operation 305, the server device 100 provides test result information to a test manager who wishes to apply the first test group among one or more test managers who manage the A/B test for the first user. It may be providing, and according to operation 303, which is the previous operation, the server device 100 provides information about the first test group to all of one or more test managers who manage the A/B test for the first user. It may be providing information. That is, the server device 100 shares information about the test group set for the first user with all of the one or more test managers who manage the A/B test for the first user, so that anyone of the one or more test managers can access the test group. However, test result information according to the application of the test group can be set to be provided separately only to the test manager who wishes to perform A/B testing through the test group.

For example, each A/B test included in the first test group may be managed in advance to ensure that there are no conflicts with each other in the first test group. In other words, each A/B test included in one test group can be applied simultaneously, so they can be set to be managed in advance to avoid conflicts between them due to test application.

It is obvious that each piece of information used in the process of the server device 100 performing an operation method for providing information according to FIGS. 3 to 8 can be combined in various forms.

The embodiments of the present invention disclosed in the specification and drawings are merely provided as specific examples to easily explain the technical content of the present invention and aid understanding of the present invention, and are not intended to limit the scope of the present invention. In other words, it is obvious to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented. Additionally, each of the above embodiments can be operated in combination with each other as needed. For example, all embodiments of the present invention can be implemented by a system by combining parts of each other.

Additionally, the method according to the system according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium.

As such, various embodiments of the present invention may be implemented as computer readable code on a computer readable recording medium in certain respects. A computer-readable recording medium is any data storage device capable of storing data that can be read by a computer system. Examples of computer readable recording media include read only memory (ROM), random access memory (RAM), and compact disk-read only memory (CD-ROM). ), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (data transmission over the Internet, etc.). Computer-readable recording media may also be distributed across networked computer systems, such that computer-readable code is stored and executed in a distributed manner. Additionally, functional programs, codes, and code segments for achieving various embodiments of the present invention can be easily interpreted by programmers skilled in the field to which the present invention is applied.

Additionally, it will be appreciated that the devices and methods according to various embodiments of the present invention can be implemented in the form of hardware, software, or a combination of hardware and software. Such software may, for example, use any storage device, volatile or non-volatile, such as ROM, whether erasable or rewritable, or memory such as, for example, RAM, memory chips, devices or integrated circuits; Alternatively, it may be stored on a storage medium that is optically or magnetically recordable and readable by a machine (e.g., a computer), for example, a compact disk (CD), DVD, magnetic disk, or magnetic tape. . Methods according to various embodiments of the present invention may be implemented by a computer including a control unit and a memory, or a vehicle including such memory or a computer, and such memory is a program containing instructions that implement the embodiments of the present invention. Alternatively, you can see that it is an example of a machine-readable storage medium suitable for storing programs.

Accordingly, the present invention includes a program containing code for implementing the device or method described in the claims of this specification and a machine-readable storage medium (such as a computer) storing such a program. Additionally, such programs may be transmitted electronically through any medium, such as communication signals transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

Although the present invention has been described above with reference to embodiments of the present invention, the embodiments of the present invention disclosed in the specification and drawings are merely presented as specific examples to easily explain the technical content of the present invention and to aid understanding of the present invention. It is not intended to limit the scope. In addition, the embodiments according to the present invention described above are merely illustrative, and those skilled in the art will understand that various modifications and equivalent scope of embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the following patent claims.

Claims

In a method for an electronic device to provide information,

Confirming information about the first user of the service to which the A/B test will be applied on a test management page that manages A/B testing for a service provided by the electronic device;

Confirming information about a first test group including one or more A/B tests set corresponding to the first user; and

Based on a first input that sets an option value for each A/B test included in the first test group, providing test result information confirmed corresponding to the first user on the service,

How to provide information.
According to claim 1,

The step of confirming information about the first user is,

Obtaining a second input for selecting the first user from among a plurality of users managed to apply A/B testing for the service; and

Comprising the step of confirming information about the first user in response to the second input,

How to provide information.
According to claim 1,

The first user is specified based on first identification information identifying the service account of the first user,

The information about the first user includes the first identification information,

How to provide information.
According to claim 3,

If a first A/B test in which an option value is set to be applied according to identification information for a service account is included in the first test group, the first A/B test corresponding to the first identification information The option value is set to the default value,

How to provide information.
According to claim 1,

The first user is specified based on second identification information identifying the user terminal of the first user,

The information about the first user includes the second identification information,

How to provide information.
According to claim 5,

If a second A/B test in which an option value is set to be applied according to identification information for the user terminal is included in the first test group, a second A/B test corresponding to the second identification information is included in the first test group. Option values are set to default values,

How to provide information.
According to claim 1,

Information about each A/B test included in the first test group,

Information about the test identification number of each A/B test above,

Information about the name of each A/B test above,

Information about one or more option values that can be set in each A/B test above,

Information on the applicable type of each A/B test above, and

Containing information about the platform to which each A/B test is applied,

How to provide information.
According to claim 1,

The first test group is included in a plurality of test groups set to correspond to the first user,

The step of checking information about the first test group is,

Confirming information about the plurality of test groups based on the information about the first user; and

Comprising the step of confirming information about the first test group based on a third input for selecting the first test group among the plurality of test groups,

How to provide information.
According to claim 1,

The first test group is set to store a state in which each A/B test included in the first test group is applied as a certain option value according to the first input,

How to provide information.
According to claim 1,

The information about the first test group includes information about one or more test state setting sets included in the first test group,

The first test state setting set included in the one or more test state setting sets stores the first test group as a state in which each A/B test included in the first test group is applied with a certain option value,

When there is a fourth input to the first test state setting set, the information on the first test group is set to be confirmed as a stored state corresponding to the first test state setting set,

How to provide information.
According to claim 1,

The first test group is set to correspond to a specific service topic for the service,

The information about the first test group includes information about the specific service topic,

How to provide information.
According to claim 1,

The method of providing the above information is:

Further comprising providing first activation information for activating whether to apply the A/B test to the first user and second activation information for activating whether to set the A/B test for the first test group,

The first test group is set based on the fifth input corresponding to the first activation information and the sixth input corresponding to the second activation information,

How to provide information.
According to claim 1,

The method of providing the above information is:

Further comprising providing information on the first test group to one or more test managers managing A/B testing for the first user,

How to provide information.
According to claim 1,

Each A/B test included in the first test group is managed in advance to ensure that there are no conflicts between each other in the first test group.

How to provide information.
In an electronic device that provides information,

processor; and

Contains one or more memories that store one or more instructions,

The one or more instructions, when executed, cause the processor to:

Confirming information about the first user of the service to which the A/B test is to be applied on a test management page that manages A/B testing for a service provided by the electronic device;

Confirming information about a first test group including one or more A/B tests set corresponding to the first user; and

Based on a first input that sets an option value for each A/B test included in the first test group, providing test result information confirmed corresponding to the first user on the service. controlling the processor,

Electronic devices.