WO2024135932A1 - Procédé de fonctionnement d'un dispositif électronique de fourniture d'informations et dispositif électronique le prenant en charge - Google Patents

Procédé de fonctionnement d'un dispositif électronique de fourniture d'informations et dispositif électronique le prenant en charge Download PDF

Info

Publication number
WO2024135932A1
WO2024135932A1 PCT/KR2023/001672 KR2023001672W WO2024135932A1 WO 2024135932 A1 WO2024135932 A1 WO 2024135932A1 KR 2023001672 W KR2023001672 W KR 2023001672W WO 2024135932 A1 WO2024135932 A1 WO 2024135932A1
Authority
WO
WIPO (PCT)
Prior art keywords
test
information
user
test group
service
Prior art date
Application number
PCT/KR2023/001672
Other languages
English (en)
Korean (ko)
Inventor
잉제무
Original Assignee
쿠팡 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 쿠팡 주식회사 filed Critical 쿠팡 주식회사
Publication of WO2024135932A1 publication Critical patent/WO2024135932A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3696—Methods or tools to render software testable
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3684—Test management for test design, e.g. generating new test cases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3692—Test management for test results analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/44—Program or device authentication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services

Definitions

  • the present invention relates to a method and device for providing information, and more specifically, to a method and electronic device for providing test result information in which an electronic device applies one or more A/B tests set for users on a service. .
  • an electronic device can provide test result information by applying one or more A/B tests set for users on a service.
  • Various embodiments may provide a method of operating an electronic device to provide information and an electronic device that supports the same.
  • a test management page that manages A/B testing for a service provided by the electronic device
  • the first user of the service to which the A/B test is to be applied Confirming information about; Confirming information about a first test group including one or more A/B tests set corresponding to the first user; And based on a first input that sets option values for each A/B test included in the first test group, providing test result information confirmed corresponding to the first user on the service.
  • confirming information about the first user includes obtaining a second input for selecting the first user from among a plurality of users managed to apply A/B testing for the service. ; and confirming information about the first user in response to the second input.
  • the first user is specified based on first identification information identifying the service account of the first user, and the information about the first user may include the first identification information.
  • setting the error occurrence information may include setting a message notifying missing data call when the specific error type corresponds to the first error type.
  • the first A/B test when a first A/B test in which an option value is set to be applied according to identification information for a service account is included in the first test group, the first A/B test identifies the first The first option value corresponding to the information may be set as the default value.
  • the first user is specified based on second identification information that identifies the user terminal of the first user, and the information about the first user may include the second identification information.
  • the second identification in the second A/B test may be set as the default value.
  • the information about each A/B test included in the first test group includes: information about the test identification number of each A/B test, information about the name of each A/B test, It may include information about one or more option values that can be set in each A/B test, information about the target type of each A/B test, and information about the platform to which each A/B test is applied. .
  • the first test group is included in a plurality of test groups set to correspond to the first user, and the step of checking information about the first test group includes information about the first user. Confirming information about the plurality of test groups based on the information; and confirming information about the first test group based on a third input for selecting the first test group among the plurality of test groups.
  • the first test group may be set to store a state in which each A/B test included in the first test group is applied as a certain option value according to the first input.
  • the information about the first test group includes information about one or more test state setting sets included in the first test group, and the first test included in the one or more test state setting sets
  • the state setting set stores the first test group in a state in which each A/B test included in the first test group is applied with a certain option value, and the fourth input to the first test state setting set is If present, it can be set so that information about the first test group can be confirmed as a stored state corresponding to the first test state setting set.
  • the first test group is set to correspond to a specific service topic for the service, and information about the first test group may include information about the specific service topic.
  • the information providing method includes first activation information activating whether to apply the A/B test to the first user and second activation information activating whether to set the first test group. It may further include the step of providing, and the first test group may be set based on a fifth input corresponding to the first activation information and a sixth input corresponding to the second activation information.
  • the information providing method may further include providing information on the first test group to one or more test managers who manage the A/B test for the first user.
  • each A/B test included in the first test group may be managed in advance so that there is no conflict between them in the first test group.
  • An electronic device that provides information includes: a processor; and one or more memories storing one or more instructions, wherein the one or more instructions, when executed, cause the processor to: manage A/B testing for services provided by the electronic device. On the test management page, confirming information about the first user of the service to which A/B testing will be applied; Confirming information about a first test group including one or more A/B tests set corresponding to the first user; And performing a step of providing test result information confirmed corresponding to the first user on the service based on a first input that sets an option value for each A/B test included in the first test group.
  • the processor can be controlled.
  • the present invention presents a method for an electronic device to provide test result information by applying one or more A/B tests set for users on a service, and has a technical effect in terms of facilitating the administrator's testing of the service.
  • FIG. 1 is a diagram illustrating an information provision system in which a method of operating an electronic device for providing information according to various embodiments can be implemented.
  • FIG. 2 is a diagram illustrating the configuration of a server device 100 and a user device 200 according to various embodiments.
  • FIG. 3 is a diagram illustrating a method of operating the server device 100 for providing information according to various embodiments.
  • Figures 4 and 5 are diagrams illustrating an example of managing A/B testing for a user based on identification information that can specify the user.
  • Figure 6 is a diagram illustrating an example of setting to store the state in which each A/B test included in a test group is applied with a certain option value.
  • FIG. 7 is a diagram illustrating an example of setting a state setting set corresponding to a test group to store a state in which each A/B test included in the test group is applied with a certain option value.
  • FIG. 8 is a diagram illustrating an example of setting a test group based on an input activating whether an A/B test can be applied to a user and an input activating whether a test group set for a user can be set.
  • each component or feature may be considered optional unless explicitly stated otherwise.
  • Each component or feature may be implemented in a form that is not combined with other components or features.
  • various embodiments may be configured by combining some components and features. The order of operations described in various embodiments may change. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments.
  • FIG. 1 is a diagram illustrating an information provision system in which a method of operating an electronic device for providing information according to various embodiments can be implemented.
  • information providing systems may be implemented in various types of electronic devices.
  • the information provision system may be implemented in the server device 100 and the user device 200.
  • the server device 100 and the user device 200 may perform operations according to various embodiments of the present disclosure based on the information provision system implemented in each device.
  • the information provision system according to various embodiments is not limited to what is shown in FIG. 1, and may be implemented in a wider variety of electronic devices and servers.
  • the server device 100 may be a device that performs wireless and wired communication with a plurality of user devices 200 and includes storage with a large storage capacity.
  • the server device 100 may be a cloud device that works with a plurality of user devices 200.
  • the user device 200 may be a device that can be used by an individual user, such as a desktop PC, tablet PC, or mobile terminal.
  • other electronic devices that perform similar functions may be used as the user device 200.
  • An information provision system may include various modules for operation. Modules included in the information provision system are implemented so that the physical device (e.g., server device 100 and user device 200) on which the information provision system is implemented (or included in the physical device) can perform specified operations. It may be computer code or one or more instructions.
  • the physical device in which the information provision system is implemented stores a plurality of modules in the memory in the form of computer code, and when the plurality of modules stored in the memory are executed, the plurality of modules are designated by the physical device corresponding to the plurality of modules. Actions can be performed.
  • FIG. 2 is a diagram illustrating the configuration of a server device 100 and a user device 200 according to various embodiments.
  • the server device 100 and the user device 200 may include an input/output unit 210, a communication unit 220, a storage 230, and a processor 240.
  • the input/output unit 210 may be various interfaces or connection ports that receive user input or output information to the user.
  • the input/output unit 210 may include an input module and an output module, and the input module receives user input from the user.
  • User input can take various forms, including key input, touch input, and voice input. Examples of input modules that can receive such user input include traditional keypads, keyboards, and mice, as well as touch sensors that detect the user's touch, microphones that receive voice signals, cameras that recognize gestures through image recognition, etc.
  • a proximity sensor including at least one of an illumination sensor or an infrared sensor that detects user approach, a motion sensor that recognizes user movement through an acceleration sensor or gyro sensor, and various other types of sensors that detect or receive user input.
  • the input module may include at least one of the devices listed above.
  • the touch sensor may be implemented as a piezoelectric or capacitive touch sensor that detects touch through a touch panel or touch film attached to the display panel, or an optical touch sensor that detects touch by an optical method.
  • the input module may be implemented in the form of an input interface (USB port, PS/2 port, etc.) that connects an external input device that receives user input instead of a device that detects user input itself.
  • the output module can output various information.
  • the output module may include at least one of a display that outputs an image, a speaker that outputs sound, a haptic device that generates vibration, and other various types of output means.
  • the output module may be implemented in the form of a port-type output interface that connects the individual output means described above.
  • a display-type output module can display text, still images, and moving images.
  • Displays include liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, flat panel display (FPD), and transparent display.
  • LCD liquid crystal display
  • LED light emitting diode
  • OLED organic light emitting diode
  • FPD flat panel display
  • transparent display Among various types of devices that can perform image output functions such as display, curved display, flexible display, 3D display, holographic display, projector, and other It can contain at least one.
  • This display may be in the form of a touch display integrated with the touch sensor of the input module.
  • the communication unit 220 can communicate with other devices. Accordingly, the server device 100 and the user device 200 can transmit and receive information with other devices through the communication unit. For example, the server device 100 and the user device 200 may communicate with each other or with other devices using a communication unit.
  • the communication department includes a wired communication module that connects to the Internet through a LAN (Local Area Network), a mobile communication module that transmits and receives data by connecting to a mobile communication network through a mobile communication base station, and a WLAN (Wireless Local Area Network) such as Wi-Fi.
  • a short-distance communication module using an Area Network-type communication method or a WPAN (Wireless Personal Area Network)-type communication method such as Bluetooth or Zigbee, and a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System) ) may include a satellite communication module using a satellite communication module or a combination thereof.
  • Storage 230 can store various types of information. Storage 230 may store data temporarily or semi-permanently.
  • the storage 230 of the server device 100 contains an operating program (OS: Operating System) for running the server device 100, a program for generating data or Braille for hosting a website, or an application (e.g. For example, data related to a web application) may be stored.
  • OS Operating System
  • the storage 230 may store modules in the form of computer code as described above.
  • Examples of storage 230 include hard disk drive (HDD), solid state drive (SSD), flash memory, read-only memory (ROM), random access memory (RAM), etc. This can be.
  • This storage 230 may be provided as a built-in type or a detachable type.
  • the processor 240 controls the overall operation of the server device 100 and the user device 200. To this end, the processor 240 can perform calculations and processing of various information and control the operation of components of the server device 100. For example, the processor 240 may execute a program or application to provide information.
  • the processor 240 may be implemented as a computer or similar device using hardware, software, or a combination thereof. In hardware, the processor 240 may be implemented in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, it may be implemented in the form of a program that drives the hardware processor 240. Meanwhile, unless otherwise specified in the following description, the operations of the server device 100 and the user device 200 may be interpreted as being performed under the control of the processor 240. That is, when modules implemented in the above-described information provision system are executed, the modules may be interpreted as the processor 240 controlling the server device 100 and the user device 200 to perform the following operations.
  • various embodiments may be implemented through various means.
  • various embodiments may be implemented by hardware, firmware, software, or a combination thereof.
  • methods include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs. It can be implemented by (field programmable gate arrays), processor, controller, microcontroller, microprocessor, etc.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • processor controller, microcontroller, microprocessor, etc.
  • firmware or software methods according to various embodiments may be implemented in the form of modules, procedures, or functions that perform the functions or operations described below.
  • software code can be stored in memory and run by a processor.
  • the memory may be located inside or outside the processor, and may exchange data with the processor through various known means.
  • FIG. 3 is a diagram illustrating a method of operating the server device 100 for providing information according to various embodiments.
  • the server device 100 provides test result information corresponding to the A/B test set for the user, and manages the A/B test for the service to perform the operation of providing test result information.
  • information about the first user of the service to which the A/B test is to be applied is confirmed (301), and information about the first test group including one or more A/B tests set in response to the first user Check (303), and based on the first input that sets the option value for each A/B test included in the first test group, test result information confirmed in response to the first user on the service can be provided. There is (305).
  • the operation of the server device 100 providing test result information may be performed for a service provided by the server device 100 or a service related to the server device 100, and the service is sold in the service. It may correspond to a service that allows multiple users who use the service to order and purchase multiple items.
  • the plurality of items sold in the service are not limited to the type or type of the item and may include various types or types of items registered by the seller to sell the item.
  • the user whose information the server device 100 checks is a user managed in advance so that A/B testing can be applied, and the server device 100 identifies the user's account or the user's terminal and A/B testing can be applied to users in a specified format, and the user's account or terminal designated for such A/B testing can be shared with various test managers for the service. Test managers who share the user's account or terminal designated for A/B testing apply the A/B test desired by each test manager to the designated user's account or terminal and check the test results in the user's account or terminal. You can test the service by doing this.
  • A/B testing may refer to a testing method that determines the results and effects by applying and comparing two or more content/versions to specific sub-services or functions of the service, and may be split testing and/or bucket testing. It can also be understood as
  • the server device 100 may check information about the first user of the service to which the A/B test is to be applied on a test management page that manages A/B testing for the service. .
  • operation 301 in which the server device 100 confirms information about the first user includes obtaining an input for selecting the first user from among a plurality of users managed to apply A/B testing for the service, This may correspond to an operation of providing information about the first user selected in response to the obtained input.
  • multiple users can be managed by being identified and designated through an account or terminal. Among the multiple users managed in this way, the test manager selects the first user.
  • the server device 100 can check information about the first user.
  • the first user may be specified based on first identification information that identifies the service account of the first user, and the information about the first user identified by the server device 100 in operation 301 includes the first user. 1 May contain identifying information.
  • identification information that identifies the first user's service account may be used to manage and identify the first user to whom A/B testing is to be applied.
  • An example of such identification information is the serial number corresponding to the user's service account. There may be a serial number.
  • the first user may be specified based on second identification information that identifies the user terminal of the first user, and the information about the first user identified by the server device 100 in operation 301 includes the first user. 2 May include identifying information.
  • identification information that identifies the first user's user terminal may be used to manage and identify the first user to whom A/B testing is to be applied.
  • An example of such identification information is the individual corresponding to the user's user terminal. There may be a terminal identifier (Personal Computer Identifier (PCID)).
  • PCID Personal Computer Identifier
  • Figures 4 and 5 are diagrams illustrating an example of managing A/B testing for a user based on identification information that can specify the user.
  • the user managed to apply the A/B test may be specified based on identification information identifying the service account (401), and the test for applying the A/B test to the user corresponding to the service account
  • the test manager can apply each A/B test included in the test group to the user and check the test results in the user's service account.
  • the user managed to apply the A/B test may be specified based on identification information identifying the user terminal (501), and a test for applying the A/B test to the user corresponding to the user terminal
  • the group is set (503), and the test manager can apply each A/B test included in the test group to the user and check the test results on the user's user terminal.
  • the server device 100 may check information about the first test group including one or more A/B tests set to correspond to the first user.
  • the information about the first test group that the server device 100 confirms according to operation 303 may include information about each A/B test included in one or more A/B tests in the first test group.
  • Information about each A/B test includes: 1) information about the test identification number of each A/B test, 2) information about the name of each A/B test, 3) one or more information that can be set in each A/B test. It may include information about option values, 4) information about the type to which each A/B test is applied, and/or 5) information about the platform to which each A/B test is applied.
  • the test identification number of the A/B test refers to a number given to identify the A/B test
  • one or more option values that can be set in the A/B test are multiple content/contents to be compared through the A/B test. It may refer to the value of the option to apply the version.
  • One or more option values that can be set in an A/B test may be in the form of A, B, C, ⁇ , None, etc., which means content/version (A) corresponding to option A, content/version (A) corresponding to option B ( B), it may mean a value set to apply content/version (C) corresponding to option C, ... or a value set not to apply any content/version (None).
  • the type to which A/B testing is applied refers to the type to which the A/B test is applied, such as the type to which the A/B test is applied to service accounts or the type to which the A/B test is applied to user terminals. This may mean specifying whether it is applied as a type.
  • one A/B test is 1) which content/version is applied only to service accounts for which the ending digit of the service account identification information is an odd number, or 2) which content/version is applied only to service accounts where the ending digit of the service account identification information is an odd number.
  • One content/version is applied to a service account with an odd number and a different content/version is applied to a service account with an even number, or 3) targeting user terminals with an odd number at the end of the identification information for the user terminal. 4) Which content/version is applied to the user terminal whose identification information for the user terminal has an odd number at the end, and a different content/version is applied to the user terminal whose ending digit is an even number? It can be classified into various types depending on its application type, and information about these types can be included in the information about A/B testing.
  • the platform to which A/B testing is applied may refer to the platform of the device that serves the service to which A/B testing is applied. For example, for smartphones, A/B testing is performed on each version of IOS and/or Android. The platform to which the test is applied can be determined.
  • a first user is specified based on first identification information that identifies the service account of the first user, and the server device 100 includes the first identification information in the information about the first user identified in operation 301.
  • an A/B test included in the first test group that the server device 100 checks in accordance with operation 303 corresponds to a test in which an option value is set to be applied according to identification information for the service account. If so, the server device 100 may manage the first option value corresponding to the first identification information to be set as a default value in the corresponding A/B test.
  • the first A/B test included in the first test group that the server device 100 checks in accordance with operation 303 is specific to a service account where the ending digit of the identification information for the service account is an odd number.
  • the first option value may be automatically set to a default value in response to the first identification information.
  • a first user is specified based on second identification information that identifies the user terminal of the first user, and the server device 100 adds the second identification information to the information about the first user identified in operation 301.
  • an A/B test included in the first test group that the server device 100 checks in accordance with operation 303 corresponds to a test in which an option value is set to be applied according to identification information for the user terminal. If so, the server device 100 may manage the second option value corresponding to the second identification information to be set as a default value in the corresponding A/B test.
  • the second A/B test included in the first test group that the server device 100 checks in accordance with operation 303 is specific to the user terminal where the ending digit of the identification information for the user terminal is an even number.
  • the second option value corresponding to the second identification information may be automatically set as the default value.
  • the first test group for which the server device 100 checks information according to operation 303 may be included in a plurality of test groups set to correspond to the first user, and the server for checking information about the first test group Operation 303 of the device 100 involves the server device 100 checking information about a plurality of test groups set for the first user based on information about the first user, and selecting a first test group among the plurality of test groups. This may correspond to an operation of checking information about the first test group based on the input of the selected test manager.
  • multiple test groups can be set for managed users so that A/B testing can be applied, and when the test manager selects the desired test group, the server device 100 can check information about the selected test group. there is.
  • the server device 100 responds to the first user on the service based on a first input that sets an option value for each A/B test included in the first test group. It is possible to provide confirmed test result information.
  • the test result information provided by the server device 100 according to operation 305 may include information about the results shown on the service by applying each A/B test included in the first test group.
  • the test manager can set option values for each A/B test included in the first test group, have the test group applied to the first user, and obtain results confirmed accordingly. If the test manager wants to apply only some A/B tests included in the test group, set the desired option value for some of the desired A/B tests, set the option value of None for the remaining A/B tests, etc.
  • the test group can be applied to the first user in the following manner.
  • the first test group is such that each A/B test included in the first test group has a certain option value according to the first input that sets the option value for each A/B test included in the first test group. It can be set to save the applied state. That is, when the option value for each A/B test included in the first test group is set to a constant state according to the first input, the first test group can be managed so that the state can be stored, and based on this, The saved state can be recalled according to convenience.
  • Figure 6 is a diagram illustrating an example of setting to store the state in which each A/B test included in a test group is applied with a certain option value.
  • the first test group may be managed through a test state setting set corresponding to a subgroup that stores the state in which the option value for each A/B test included in the first test group is applied.
  • information about the first test group may include information about one or more test state setting sets included in the first test group.
  • the first test state setting set included in one or more test state setting sets for the first test group sets the first test group to a state in which each A/B test included in the first test group is applied with a certain option value. It can be stored, and if there is an input for selecting a first test state setting set among one or more test state setting sets in the information about the first test group, the first test group is saved as a state corresponding to the first test state setting set. Information about can be confirmed.
  • the second test state setting set included in the one or more test state setting sets may store the first test group in a state in which each A/B test included in the first test group is applied with a certain option value.
  • the state in which the option value of each A/B test included in the first test group is applied through the second test state setting set may be different from the first test state setting set.
  • the information for the first test group is stored corresponding to the second test state setting set. Information can be verified.
  • FIG. 7 is a diagram illustrating an example of setting a state setting set corresponding to a test group to store a state in which each A/B test included in the test group is applied with a certain option value.
  • a state in which each A/B test included in the test group is set to a certain option value (705) is a specific state setting. It can be managed to be stored in the same format as a set (707).
  • the test manager specifies an option value for each A/B test included in the test group and then inputs to save the state in which the option value is set as a status setting set, such as 707
  • each A/B Option values specified for the test can be fixed within the state setting set, and later, the state setting set can be selected from the test group and managed to retrieve the saved state as above.
  • multiple state setting sets may be set for one test group, and the test manager can select the desired state setting set among the multiple state setting sets set for one test group. By selecting , you can load a test group in which the option values of each A/B test are saved corresponding to the selected state setting set.
  • the first test group is set to correspond to a specific service topic for the service, and the information about the first test group confirmed by the server device 100 according to operation 303 includes information about the specific service topic. It can be included.
  • one test group may be a group including A/B tests that have a common topic corresponding to a specific sub-service or function on the service.
  • the test results provided by the server device 100 according to operation 305 Information may also be information identified in response to a specific service topic for the service.
  • the first test group is the first test group when the activation input for activating whether or not the A/B test is applied to the first user and the activation input for activating whether or not the setting is possible for the first test group are confirmed. It can be set to allow editing, such as adding an A/B test or deleting an A/B test from the first test group. That is, the server device 100 may provide first activation information activating whether to apply the A/B test to the first user and second activation information activating whether to set the A/B test to the first test group. The first test group may be set based on the fact that the input corresponding to the first activation information and the input corresponding to the second activation information are confirmed.
  • FIG. 8 is a diagram illustrating an example of setting a test group based on an input activating whether an A/B test can be applied to a user and an input activating whether a test group set for a user can be set.
  • first button information that determines whether to allow A/B testing to be applied to each user may be set (803) ), which determines whether to allow setting or editing test groups for management of A/B tests for each user when applying A/B testing for users based on the first button information is activated.
  • Second button information may be set (805).
  • Figure 8 it is shown that when the first button information is activated, it may be allowed to apply an A/B test for the user, and when the second button information is deactivated, it may be allowed to set or manage a test group for the user.
  • the present invention is not limited to this, and for example, unlike FIG. 8, when the second button information is activated, it may be set to allow setting or managing a test group for the user.
  • the server device 100 provides test result information to a test manager who wishes to apply the first test group among one or more test managers who manage the A/B test for the first user. It may be providing, and according to operation 303, which is the previous operation, the server device 100 provides information about the first test group to all of one or more test managers who manage the A/B test for the first user. It may be providing information. That is, the server device 100 shares information about the test group set for the first user with all of the one or more test managers who manage the A/B test for the first user, so that anyone of the one or more test managers can access the test group.
  • test result information according to the application of the test group can be set to be provided separately only to the test manager who wishes to perform A/B testing through the test group.
  • each A/B test included in the first test group may be managed in advance to ensure that there are no conflicts with each other in the first test group.
  • each A/B test included in one test group can be applied simultaneously, so they can be set to be managed in advance to avoid conflicts between them due to test application.
  • the method according to the system according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium.
  • various embodiments of the present invention may be implemented as computer readable code on a computer readable recording medium in certain respects.
  • a computer-readable recording medium is any data storage device capable of storing data that can be read by a computer system. Examples of computer readable recording media include read only memory (ROM), random access memory (RAM), and compact disk-read only memory (CD-ROM). ), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (data transmission over the Internet, etc.). Computer-readable recording media may also be distributed across networked computer systems, such that computer-readable code is stored and executed in a distributed manner. Additionally, functional programs, codes, and code segments for achieving various embodiments of the present invention can be easily interpreted by programmers skilled in the field to which the present invention is applied.
  • the devices and methods according to various embodiments of the present invention can be implemented in the form of hardware, software, or a combination of hardware and software.
  • Such software may, for example, use any storage device, volatile or non-volatile, such as ROM, whether erasable or rewritable, or memory such as, for example, RAM, memory chips, devices or integrated circuits; Alternatively, it may be stored on a storage medium that is optically or magnetically recordable and readable by a machine (e.g., a computer), for example, a compact disk (CD), DVD, magnetic disk, or magnetic tape. .
  • a machine e.g., a computer
  • Methods according to various embodiments of the present invention may be implemented by a computer including a control unit and a memory, or a vehicle including such memory or a computer, and such memory is a program containing instructions that implement the embodiments of the present invention.
  • a computer including a control unit and a memory
  • a vehicle including such memory or a computer
  • such memory is a program containing instructions that implement the embodiments of the present invention.
  • the present invention includes a program containing code for implementing the device or method described in the claims of this specification and a machine-readable storage medium (such as a computer) storing such a program. Additionally, such programs may be transmitted electronically through any medium, such as communication signals transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

La présente divulgation concerne un procédé de fourniture d'informations par un dispositif électronique, ce procédé comprenant les étapes consistant à : identifier, sur une page de gestion de test qui gère un test A/B pour un service fourni par le dispositif électronique, des informations concernant un premier utilisateur du service auquel le test A/B doit être appliqué ; identifier des informations concernant un premier groupe de tests comprenant un ou plusieurs tests A/B et configuré en fonction du premier utilisateur ; et sur la base d'une première entrée dans laquelle une valeur d'option pour chacun des tests A/B compris dans le premier groupe de tests est configurée, fournir des informations de résultat de test identifiées correspondant au premier utilisateur, sur le service.
PCT/KR2023/001672 2022-12-19 2023-02-06 Procédé de fonctionnement d'un dispositif électronique de fourniture d'informations et dispositif électronique le prenant en charge WO2024135932A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020220178218A KR102618518B1 (ko) 2022-12-19 2022-12-19 정보를 제공하는 전자 장치의 동작 방법 및 이를 지원하는 전자 장치
KR10-2022-0178218 2022-12-19

Publications (1)

Publication Number Publication Date
WO2024135932A1 true WO2024135932A1 (fr) 2024-06-27

Family

ID=89384859

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/001672 WO2024135932A1 (fr) 2022-12-19 2023-02-06 Procédé de fonctionnement d'un dispositif électronique de fourniture d'informations et dispositif électronique le prenant en charge

Country Status (2)

Country Link
KR (2) KR102618518B1 (fr)
WO (1) WO2024135932A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010042050A (ko) * 1998-03-20 2001-05-25 레카 도날드 지. 자동 테스트 장비의 유동적인 테스트 환경
KR100810239B1 (ko) * 2006-11-30 2008-03-06 삼성전자주식회사 자동화 테스트 시스템 및 그 방법
JP2010003224A (ja) * 2008-06-23 2010-01-07 Hitachi Ltd テスト情報管理サーバ、テスト情報管理方法、およびプログラム
KR20190112591A (ko) * 2018-03-26 2019-10-07 주식회사 하이퍼커넥트 테스트 그룹 분배 방법을 실행하기 위한 컴퓨터 프로그램 및 서버
KR20220121175A (ko) * 2021-02-24 2022-08-31 더 보잉 컴파니 시스템 테스트 절차를 이용하는 통합 테스트 절차의 자동 발생

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010042050A (ko) * 1998-03-20 2001-05-25 레카 도날드 지. 자동 테스트 장비의 유동적인 테스트 환경
KR100810239B1 (ko) * 2006-11-30 2008-03-06 삼성전자주식회사 자동화 테스트 시스템 및 그 방법
JP2010003224A (ja) * 2008-06-23 2010-01-07 Hitachi Ltd テスト情報管理サーバ、テスト情報管理方法、およびプログラム
KR20190112591A (ko) * 2018-03-26 2019-10-07 주식회사 하이퍼커넥트 테스트 그룹 분배 방법을 실행하기 위한 컴퓨터 프로그램 및 서버
KR20220121175A (ko) * 2021-02-24 2022-08-31 더 보잉 컴파니 시스템 테스트 절차를 이용하는 통합 테스트 절차의 자동 발생

Also Published As

Publication number Publication date
KR20240096422A (ko) 2024-06-26
KR102618518B1 (ko) 2023-12-28

Similar Documents

Publication Publication Date Title
WO2024117384A1 (fr) Procédé de gestion d'informations de test et dispositif électronique le prenant en charge
WO2015093754A1 (fr) Procédé et dispositif de partage d'informations de connexion dans un dispositif électronique
WO2024135932A1 (fr) Procédé de fonctionnement d'un dispositif électronique de fourniture d'informations et dispositif électronique le prenant en charge
WO2023033219A1 (fr) Procédé de fonctionnement pour fournir des informations relatives à un service et dispositif électronique le prenant en charge
WO2023229093A1 (fr) Procédé de gestion d'informations d'inventaire et dispositif électronique le prenant en charge
WO2019160323A1 (fr) Procédé de gestion de données associées à une application et dispositif électronique correspondant
WO2023106492A1 (fr) Procédé de fonctionnement pour une configuration de structure de desserte de données et dispositif électronique pour sa prise en charge
WO2023214604A1 (fr) Procédé de fonctionnement d'un dispositif électronique permettant de définir des informations, et dispositif électronique le prenant en charge
WO2024181646A1 (fr) Procédé de fonctionnement d'un dispositif électronique gérant la transmission d'informations et dispositif électronique prenant en charge celui-ci
WO2024111750A1 (fr) Procédé de fonctionnement d'un dispositif électronique pour fournir des informations et dispositif électronique le prenant en charge
WO2024150870A1 (fr) Procédé d'exploitation d'un dispositif électronique pour la fourniture d'informations, et dispositif électronique le prenant en charge
WO2023249151A1 (fr) Procédé de fonctionnement d'un appareil électronique pour effectuer une mise à jour de mémoire cache et appareil électronique prenant en charge celui-ci
WO2024010116A1 (fr) Procédé pour commander un dispositif électronique fournissant des informations, et dispositif électronique le prenant en charge
WO2024143676A1 (fr) Procédé pour une gestion d'informations de compte, et dispositif électronique le prenant en charge
WO2023017878A1 (fr) Procédé de fonctionnement pour fournir des informations de groupe d'articles et dispositif électronique pour le prendre en charge
WO2024090639A1 (fr) Procédé d'exploitation d'un dispositif électronique pour fournir des informations et dispositif électronique le prenant en charge
WO2023191154A1 (fr) Procédé de fonctionnement d'un dispositif électronique pour fournir une page, et dispositif électronique le prenant en charge
WO2023191153A1 (fr) Procédé de fonctionnement d'un dispositif électronique pour configurer des informations et dispositif électronique le prenant en charge
WO2023249150A1 (fr) Procédé permettant de faire fonctionner un dispositif électronique fournissant des informations, et dispositif électronique le prenant en charge
WO2023063501A1 (fr) Procédé permettant de faire fonctionner un dispositif électronique pour fournir des informations de page et dispositif électronique le prenant en charge
WO2024085319A1 (fr) Procédé de commande d'un dispositif électronique fournissant des informations, et dispositif électronique le prenant en charge
WO2023033218A1 (fr) Procédé de fonctionnement pour la fourniture d'informations relatives à un service et dispositif électronique le prenant en charge
WO2024058294A1 (fr) Procédé de fonctionnement de dispositif électronique pour un traitement d'informations et dispositif électronique le prenant en charge
WO2023191157A1 (fr) Procédé de fonctionnement d'un dispositif électronique pour fournir une page, et dispositif électronique le prenant en charge
WO2024147404A1 (fr) Procédé de fonctionnement d'un dispositif électronique configurant une attribution de tâche de livraison, et dispositif électronique prenant en charge celui-ci

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23907226

Country of ref document: EP

Kind code of ref document: A1