KR102329939B1 - VR-Powered Scenario-Based Testing Method and Apparatus for Visual and Acoustic Web of Things Service - Google Patents

Abstract

A virtual reality-based scenario testing method and apparatus for visual and acoustic web services are presented. A method for testing a virtual reality-based scenario of a web service performed by an apparatus for testing a virtual reality-based scenario of a web of things according to an embodiment is a method for performing a Web of Things (WoT) service in order to provide a test environment for various test scenarios. constructing a scenario-based test framework; and testing the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality).

Description

VR-Powered Scenario-Based Testing Method and Apparatus for Visual and Acoustic Web of Things Service

The following embodiments relate to a virtual reality (VR)-based scenario testing method and apparatus of a visual and acoustic Web of Things (WoT) service.

Recent developments in networking systems have extended the boundaries of the traditional web to the Web of Things (WoT). WoT enables services on the web, called WoT services, to actively interact with physical objects in the environment. In particular, a visual and acoustic WoT service that emits light and sound through a physical device, respectively, is the most common type of WoT service.

In order to test the operation or detection function of these WoT services, scenario-based tests can be performed by building a real test bed composed of various physical devices. Scenario-based testing is generally considered an effective technique for testing software while taking into account various human factors that cannot be tested using a limited set of tests. On the other hand, building a real testbed is expensive to install a number of physical devices or change configurations.

In recent studies, virtual reality (VR) techniques have been used to imitate psychological experiments (Non-Patent Document 1). In addition, another recent study suggested the use of VR in user research to experience the perspectives of the elderly with poor eyesight.

Ma, X., Packett, M., Park, L., Chien, E., Naaman, M.: Web-based VR experiments powered by the crowd. In: Proceedings of the 2018 World Wide Web Conference on World Wide Web, pp. 33-43. International World Wide Web Conferences Steering Committee (2018).

Embodiments describe a virtual reality-based scenario testing method and apparatus of a visual and acoustic web service of things, and more specifically, by using virtual reality technology to test the function of an Internet of Things service in a virtual environment, cost-effectively in various environments It provides technology to test IoT services.

The embodiments propose to recognize a scenario-based test framework for a visual and acoustic WoT service in a physical environment, and a visual and acoustic web of things that can efficiently develop a plurality of test scenarios through VR-based implementation of the framework An object of the present invention is to provide a method and apparatus for testing a virtual reality-based scenario of a service.

A method for testing a virtual reality-based scenario of a web service performed by an apparatus for testing a virtual reality-based scenario of a web of things according to an embodiment is a method for performing a Web of Things (WoT) service in order to provide a test environment for various test scenarios. constructing a scenario-based test framework; and testing the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality).

The WoT service may be a visual and acoustic WoT service in which a web service actively interacts with physical objects in the environment and produces light and sound through a physical device, respectively.

In the configuring a scenario-based test framework for the WoT service, the scenario of the test framework may be configured to reflect a user pattern, an environment, and a service interference.

The scenario of the test framework reflects the user pattern in which the user moves, and the WoT service may track the user's location and provide the service by finding a display or speaker that is spatially closest to the user.

The configuring of the scenario-based test framework for the WoT service may include applying a scenario of the scenario-based test framework for the WoT service to Equation (1).

[Equation 1]

c = {U, env, I}

Here, U is a user pattern, env is an environment, and I is a service interference.

The environment includes configurations for all entities in the scenario, and when there is no predetermined user pattern or interference service, the user pattern or service interference can be expressed as an empty set.

The step of configuring the scenario-based test framework for the WoT service may include extending the scenario of the scenario-based test framework for the WoT service and applying a scenario including the specific movement path of the user to Equation 2 to configure. can

[Equation 2]

} c _mobility = {{mobility _u }, env _c ,

}

는 서비스 간섭이 없는 것이다.where {mobility _u } is a user pattern including a specific movement path, env _c is an environment,

is no service interference.

In the step of configuring the scenario-based test framework for the WoT service, the scenario is expanded by inserting an interference model to test the interference situation in which another service generates light or sound in the scenario including the user's specific movement path. and can be configured by applying Equation (3).

[Equation 3]

c _i = {{mobility _u }, env _c , {noise, glare}}

Here, {noise, glare} is service interference in which another service generates light or sound.

A virtual reality-based scenario testing apparatus of a web service according to another embodiment includes: a test framework unit configured to configure a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and a VR implementation unit that tests the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality).

The WoT service may be a visual and acoustic WoT service in which a web service actively interacts with physical objects in the environment and produces light and sound through a physical device, respectively.

The test framework unit, the scenario of the test framework may be configured to reflect a user pattern (user pattern), environment (environment) and service interference (service interference).

The test framework unit may be configured by applying a scenario of a scenario-based test framework for the WoT service to Equation (1).

[Equation 1]

c = {U, env, I}

Here, U is a user pattern, env is an environment, and I is a service interference.

The environment includes configurations for all entities in the scenario, and when there is no predetermined user pattern or interference service, the user pattern or service interference can be expressed as an empty set.

The test framework unit may extend a scenario of a scenario-based test framework for the WoT service and configure a scenario including the user's specific movement path by applying Equation 2 to Equation (2).

[Equation 2]

} c _mobility = {{mobility _u }, env _c ,

}

는 서비스 간섭이 없는 것이다.where {mobility _u } is a user pattern including a specific movement path, env _c is an environment,

is no service interference.

The test framework unit extends the scenario by inserting an interference model to test an interference situation in which another service generates light or sound in a scenario including the user's specific movement path, and can be configured by applying Equation 3 have.

[Equation 3]

c _i = {{mobility _u }, env _c , {noise, glare}}

Here, {noise, glare} is service interference in which another service generates light or sound.

According to embodiments, virtual reality-based scenario testing of a visual and acoustic web service of things that can cost-effectively test the Internet of Things service in various environments by using virtual reality technology to test the function of the Internet of Things service in a virtual environment Methods and apparatus can be provided.

According to embodiments, it is proposed to recognize a scenario-based test framework for a visual and acoustic WoT service in a physical environment, and a plurality of test scenarios can be efficiently developed through VR-based implementation of the framework. It is possible to provide a virtual reality-based scenario testing method and apparatus of a web of things.

1 is a diagram illustrating a preliminary model of a scenario-based test framework for a WoT service according to an embodiment.
2 is a diagram for explaining an example of a news delivery service according to an embodiment.
3 is a flowchart illustrating a virtual reality-based scenario testing method of a web service according to an embodiment.
4 is a block diagram illustrating an apparatus for testing a virtual reality-based scenario of a web service according to an embodiment.
5A is a diagram for explaining an example of an environment of a VR-based simulation according to an embodiment.
5B is a diagram for explaining an example of a user of a VR-based simulation according to an embodiment.

Hereinafter, embodiments will be described with reference to the accompanying drawings. However, the described embodiments may be modified in various other forms, and the scope of the present invention is not limited by the embodiments described below. In addition, various embodiments are provided in order to more completely explain the present invention to those of ordinary skill in the art. The shapes and sizes of elements in the drawings may be exaggerated for clearer description.

A Web of Things (WoT) service is a web service that interacts with physical objects in an environment. WoT services should be tested taking into account physical and human factors that affect the quality of WoT services. Scenario-based testing is known as one of the most effective testing techniques for testing software while considering a variety of real-world scenarios. However, applying scenario-based tests to actual WoT testbed environments is not practical in terms of cost and reconfiguration. In this work, virtual reality (VR) technology is used to mimic real-world WoT environments for cost-effective testing of various scenarios.

In this embodiment, a scenario-based test framework for WoT service is first proposed to enable systematic development of a test environment for various test scenarios. Next, we describe a VR-based implementation of a framework such as a virtual WoT environment for scenario-based testing to reduce the testing cost of various scenarios. Clearly, developing a physical environment is less expensive than building a real testbed, and changing the configuration is relatively easy. In the demonstration, the implementation of the framework is shown, and users experience how scenario-based tests for WoT services can be performed based on the proposed framework.

1 is a diagram illustrating a preliminary model of a scenario-based test framework for a WoT service according to an embodiment.

Referring to FIG. 1 , a preliminary model of a scenario-based test framework for a WoT service according to an embodiment is shown, and the WoT service to be tested may be expressed as follows.

s = {E, R}

A target WoT service may be composed of an effect E generated by the service and a required capability R. A service may test a set C of scenarios by a set T of testers.

The scenario can be expressed as follows.

c = {U, env, I}

Scenario c may consist of user pattern U, environment env, and service interference I. The framework according to an embodiment may insert a pattern for some dynamics of the user, such as mobility, so that the tester may follow a predetermined mobility pattern or simply move freely.

Environment env may consist of service S, device D and physical object O. Here, the service may be a web or WoT service. An appropriate device may be found and obtained by the service according to the required capability of the service. The environment may contain other services that cause interference within the target service in terms of physical impact, and such interference models should be included in the scenario definition.

2 is a diagram for explaining an example of a news delivery service according to an embodiment.

As an example of motivating, as shown in FIG. 2 , a simple service for delivering headline news to a user in the morning, a so-called news delivery service 210 can be considered. The news may be expressed in visual text or audio format and delivered to the user using a physical device 220 such as a display or speaker, respectively.

Since the user is mobile, the news delivery service 210 must check the user's movement pattern 230 . Accordingly, the news delivery service 210 needs to track the location of the user and find media spatially closer to the user to deliver the news to the user. Although the purpose of the news delivery service 210 is to deliver news to the user, evaluation of the news delivery service 210 may be performed by examining how well the user delivers and perceives the news. After the developer of the news delivery service 210 completes implementation, it is necessary to evaluate whether the functionality of the news delivery service 210 generally works by performing scenario-based tests in various environments 240 .

According to the framework, the news delivery service 210 may be defined as follows.

s _news = {{light, sound}, {display, speaker}}

To test the news delivery service 210, a basic scenario may be designed as follows.

, env_c,

}c = {

, env _c ,

}

}은 미리 정해진 사용자 패턴이나 방해 서비스가 없다는 것을 의미한다. Here, the environment env _c may contain configurations for all objects in the scenario. The empty set of user patterns and interferences {

} means that there is no predefined user pattern or interfering service.

The extended scenario can be designed based on the basic scenario as follows. A specific movement path that is the user movement pattern 230 will be included in the scenario, and may be expressed as follows.

} c _mobility = {{mobility _u }, env _c ,

}

The basic scenario can be extended by inserting an interference model to test whether news is delivered to the user even in a situation where other services generate light or sound, that is, in a situation where interference 250 occurs. can

c _i = {{mobility _u }, env _c , {noise, glare}}

In order to test the news delivery service 210 in another environment, the environment 240 of the scenario may be simply replaced with another environment, and may be expressed as follows.

env' _c : c _env = {{mobility _u }, env' _c , {noise, glare}}

3 is a flowchart illustrating a virtual reality-based scenario testing method of a web service according to an embodiment.

Referring to FIG. 3 , a method for testing a virtual reality-based scenario of a web service performed by an apparatus for testing a virtual reality-based scenario of a web of things according to an embodiment is applied to a WoT service in order to provide a test environment for various test scenarios. A step 310 of configuring a scenario-based test framework for can

In embodiments, IoT devices affect a user or environment visually and/or acoustically, and it is necessary to test software that controls the devices to provide a certain service. However, since it is difficult to test in various environments due to the cost problem occurring during testing in the real environment, in this embodiment, by using the virtual reality technology to test the function of the Internet of Things service in the virtual environment, Internet services can be tested.

Hereinafter, each step of the virtual reality-based scenario testing method of the web of things according to an embodiment will be described.

The virtual reality-based scenario testing method of the web of things service according to an embodiment may be described in more detail through the virtual reality-based scenario testing apparatus of the web service of things. The virtual reality-based scenario testing method of the web service according to an embodiment may be performed through a virtual reality-based scenario testing device of the web service, wherein the virtual reality-based scenario testing device of the web service may be implemented with a computer. have.

4 is a block diagram illustrating an apparatus for testing a virtual reality-based scenario of a web service according to an embodiment.

Referring to FIG. 4 , a virtual reality-based scenario testing apparatus 400 of a web service according to an embodiment may include a test framework unit 410 and a VR implementation unit 420 . Here, the virtual reality-based scenario testing apparatus 400 of the web service may be implemented as a computer, for example, as a processor of a computer system. For example, the processor may include a test framework unit 410 and a VR implementation unit 420 . These processor components may be representations of different functions performed by the processor in accordance with control instructions provided by at least one program code.

In step 310 , the test framework unit 410 may configure a scenario-based test framework for the WoT service to provide a test environment for various test scenarios. Here, the WoT service may be a visual and acoustic WoT service in which a web service actively interacts with physical objects in the environment and produces light and sound through a physical device, respectively.

The test framework unit 410 may be configured such that a scenario of the test framework reflects a user pattern, environment, and service interference.

As an example, a scenario in the test framework may reflect a user pattern in which the user moves. In this case, the WoT service may track the user's location to reflect the user's movement pattern, find a display or speaker that is spatially closest to the user, and provide the service. The WoT service may be provided through at least one computer, server, or the like. For example, the WoT service can track the location of the user by tracking the location through the GPS (Global Positioning System) of the user terminal possessed by the user. A service may be delivered to a user by selecting a nearby physical device and providing the service through sight or sound. Here, the user terminal includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, a slate PC, and a tablet PC ( tablet PC), ultrabooks, and the like.

More specifically, the test framework unit 410 may be configured by applying a scenario of a scenario-based test framework for the WoT service to Equation (1). Meanwhile, since the test framework has been described with reference to FIG. 1 , it will be briefly described here.

[Equation 1]

c = {U, env, I}

Here, U is the user pattern, env is the environment, and I is the service interference. The environment includes the configuration of all entities in the scenario, and when there is no predetermined user pattern or interfering service, the user pattern or service interference can be expressed as an empty set.

In addition, the test framework unit 410 may extend the scenario of the scenario-based test framework for the WoT service to apply a scenario including a specific movement path of the user to Equation 2 to configure it.

[Equation 2]

} c _mobility = {{mobility _u }, env _c ,

}

는 서비스 간섭이 없는 것이다.where {mobility _u } is a user pattern including a specific movement path, env _c is an environment,

is no service interference.

In addition, the test framework unit 410 inserts an interference model to test an interference situation in which other services generate light or sound in a scenario including a specific movement path of the user to expand the scenario, and apply Equation 3 to configurable.

[Equation 3]

c _i = {{mobility _u }, env _c , {noise, glare}}

Here, {noise, glare} is service interference in which another service generates light or sound.

In step 320 , the VR implementation unit 420 may test the operation or detection function of the WoT service in the virtual environment by implementing the test framework based on VR. For example, a user experiences a virtual environment through sight or sound by utilizing a Head Mount Display (HMD), and by interacting with a service in the environment using a controller, the operation or detection function of the WoT service can be tested in the virtual environment. can

Accordingly, by examining how well the WoT service is delivered and perceived, the operation or detection function of the WoT service can be evaluated.

The VR-based simulation environment and users of the WoT service are described below.

5A is a diagram for explaining an example of an environment of a VR-based simulation according to an embodiment.

As shown in FIG. 5A , a virtual environment can be implemented in a three-dimensional space using Unreal Engine, which is the most used game engine for VR-based simulation development.

5B is a diagram for explaining an example of a user of a VR-based simulation according to an embodiment.

As shown in FIG. 5B , the tester can wear the HTC Vive Pro, one of the most common HMDs in VR, for immersion in the virtual environment and interaction with the HMD and the controller. Users can utilize the HMD to visually and acoustically experience the virtual environment, and use the controller to interact with services in the environment.

In this embodiment, it is proposed to recognize a scenario-based test framework for the visual and acoustic WoT service in the physical environment, and VR-based implementation of the framework has been described. VR enables the efficient development of multiple test scenarios, allowing testers to test the target service to reflect as many real-world examples as possible.

As described above, the embodiments may improve the quality through testing during the overall development process of a software service that provides a function to a user by using IoT devices. Accordingly, through the embodiments, the quality and safety of the Internet of Things (IoT) service may be improved in society as a whole.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. may be embodied in The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and carry out program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc., are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (15)

In the virtual reality-based scenario testing method of the web service of things performed by a virtual reality-based scenario testing apparatus of the web service,
configuring a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
Testing the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The WoT service is
It is a visual and acoustic WoT service that actively interacts with physical objects in the environment and produces light and sound through physical devices, respectively, on the web.
A virtual reality-based scenario testing method of web services, characterized in that. delete In the virtual reality-based scenario testing method of the web service of things performed by a virtual reality-based scenario testing apparatus of the web service,
configuring a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
Testing the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The step of configuring a scenario-based test framework for the WoT service includes:
Scenarios of the test framework are configured to reflect a user pattern, an environment, and a service interference.
A virtual reality-based scenario testing method of web services, characterized in that. 4. The method of claim 3,
The scenario of the test framework reflects the user pattern in which the user moves, and the WoT service tracks the user's location and provides the service by finding a display or speaker that is spatially closest to the user.
A virtual reality-based scenario testing method of web services, characterized in that. In the virtual reality-based scenario testing method of the web service of things performed by the virtual reality-based scenario testing apparatus of the web service,
configuring a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
Testing the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The step of configuring a scenario-based test framework for the WoT service includes:
To configure by applying the scenario of the scenario-based test framework for the WoT service to Equation 1
Characterized in, a virtual reality-based scenario testing method of web services of things.
[Equation 1]
c = {U, env, I}
Here, U is a user pattern, env is an environment, and I is a service interference. 6. The method of claim 5,
The environment includes the configuration of all entities in the scenario, and when there is no predetermined user pattern or interference service, expressing the user pattern or service interference as an empty set
A virtual reality-based scenario testing method of web services, characterized in that. 6. The method of claim 5,
The step of configuring a scenario-based test framework for the WoT service includes:
Expanding the scenario of the scenario-based test framework for the WoT service and configuring a scenario including the user's specific movement path by applying Equation 2
A virtual reality-based scenario testing method of web services, characterized in that.
[Equation 2]
c _mobility = {{mobility _u }, env _c ,

}
where {mobility _u } is a user pattern including a specific movement path, env _c is an environment,

is no service interference. 8. The method of claim 7,
The step of configuring a scenario-based test framework for the WoT service includes:
In order to test an interference situation in which another service generates light or sound in a scenario including a specific movement path of the user, an interference model is inserted to expand the scenario, and to be configured by applying Equation 3
A virtual reality-based scenario testing method of web services, characterized in that.
[Equation 3]
c _i = {{mobility _u }, env _c , {noise, glare}}
Here, {noise, glare} is service interference in which another service generates light or sound. a test framework unit that configures a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
A VR implementation unit that tests the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The WoT service is
It is a visual and acoustic WoT service that actively interacts with physical objects in the environment and produces light and sound through physical devices, respectively, on the web.
A virtual reality-based scenario testing device for web services, characterized in that. delete a test framework unit that configures a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
A VR implementation unit that tests the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The test framework unit,
Scenarios of the test framework are configured to reflect a user pattern, an environment, and a service interference.
A virtual reality-based scenario testing device for web services, characterized in that. a test framework unit that configures a scenario-based test framework for a Web of Things (WoT) service to provide a test environment for various test scenarios; and
A VR implementation unit that tests the operation or detection function of the WoT service in a virtual environment by implementing the test framework based on VR (Virtual Reality)
including,
The test framework unit,
To configure by applying the scenario of the scenario-based test framework for the WoT service to Equation 1
A virtual reality-based scenario testing device of web services, characterized in that.
[Equation 1]
c = {U, env, I}
Here, U is a user pattern, env is an environment, and I is a service interference. 13. The method of claim 12,
The environment includes the configuration of all entities in the scenario, and when there is no predetermined user pattern or interference service, expressing the user pattern or service interference as an empty set
A virtual reality-based scenario testing device for web services, characterized in that. 13. The method of claim 12,
The test framework unit,
Expanding the scenario of the scenario-based test framework for the WoT service and configuring a scenario including the user's specific movement path by applying Equation 2
A virtual reality-based scenario testing device for web services, characterized in that.
[Equation 2]
c _mobility = {{mobility _u }, env _c ,

}
where {mobility _u } is a user pattern including a specific movement path, env _c is an environment,

is no service interference. 15. The method of claim 14,
The test framework unit,
In order to test an interference situation in which another service generates light or sound in a scenario including a specific movement path of the user, an interference model is inserted to expand the scenario, and to be configured by applying Equation 3
A virtual reality-based scenario testing device for web services, characterized in that.
[Equation 3]
c _i = {{mobility _u }, env _c , {noise, glare}}
Here, {noise, glare} is service interference in which another service generates light or sound.

Images