KR20240038293A - Method and apparatus for controlling video player according to motion control mode in contents streaming system - Google Patents

Abstract

The present disclosure relates to a method and device for controlling a video player according to a motion control mode in a content streaming system. The method for controlling a video player according to a motion control mode in a device including a processor and memory includes tilt detection of the device. Detecting at least one of a signal or an impact detection signal, determining a function of the video player in response to the detected signal, and controlling the video player in response to the determined function of the video player. The function of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function.

Description

Method and device for controlling a video player according to a motion control mode in a content streaming system {METHOD AND APPARATUS FOR CONTROLLING VIDEO PLAYER ACCORDING TO MOTION CONTROL MODE IN CONTENTS STREAMING SYSTEM}

This disclosure relates to a content streaming system, and to a method and device for controlling a video player in a content streaming system according to a motion control mode.

With the development of various technologies and changes in consumption trends, significant changes have occurred in the way content is supplied and consumed. Advances in digital technology, computer technology, and Internet/communication technology have blurred the boundaries between types of content and who produces them, causing major changes in production and consumption patterns for content. Platforms have emerged that allow ordinary people to create and distribute content. In addition, ease of access to various contents was secured, and various options for consumption methods began to be provided.

Among these many changes in the content industry, OTT (over the top) services exist. OTT service is a media platform based on the Internet and mobile communications that goes beyond existing broadcasting services and provides consumers with a variety of content without the need for equipment such as a separate set-top box. The concept of OTT service first began with providing movies, television programs, etc. in VOD (video on demand), but it is still expanding its scope to include mobile platforms as well as providing OTT service providers' self-produced content. This service is in the process of expansion.

The present disclosure is to provide a method and device for controlling a video player according to a motion control mode.

The present disclosure is intended to provide a method and device for easier operation of a video player.

The present disclosure is intended to control the functions of a video player using a motion control mode.

The technical problems to be achieved by this disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description below. You will be able to.

According to an embodiment of the present disclosure, a method of controlling a video player according to a motion control mode includes detecting at least one of a tilt detection signal or an impact detection signal of a device, A step of determining a function of the video player and controlling the video player in response to the determined function of the video player, wherein the functions of the video player include a volume control function, a brightness control function, a play/pause function, or a fast forward function. /May include at least one of the rewind functions.

According to an embodiment of the present disclosure, the method may further include detecting a user's mode change request and switching the operation mode of the video player to the motion control mode in response to the user's mode change request.

According to an embodiment of the present disclosure, the user's request to switch modes may correspond to at least one of the user's touch input, device shaking motion, or time setting.

According to an embodiment of the present disclosure, the user's touch input may be a touch input for a certain period of time or more on a rewind item or a fast forward item among video manipulation items included in the user interface of the video player.

According to an embodiment of the present disclosure, the tilt detection signal may include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, or an upper rotation signal of the device.

According to an embodiment of the present disclosure, the function of the video player corresponding to at least one of the tilt detection signal or the impact detection signal may be set by the user.

According to one embodiment of the present disclosure, receiving status information of a user and

It may include switching the operation mode of the video player to the motion control mode in response to the user's status information.

According to an embodiment of the present disclosure, the user's status information may include information about at least one of the user's location, the user's exercise state, or the user's means of transportation.

According to one embodiment of the present disclosure, information about the user's location may be determined by a Global Positioning System (GPS) signal or an identifier of an access point of a wireless network.

According to one embodiment of the present disclosure, information about the user's exercise state or the user's means of transportation may be detected by at least one of a gyroscope, an acceleration sensor, or a GPS sensor inside the device.

According to an embodiment of the present disclosure, recognizing the occurrence of a situation of readjustment of function control, confirming the control actually performed by the device and the control intended by the user, and updating the mapping relationship between the motion signal and the function control. May include steps.

According to an embodiment of the present disclosure, a device for controlling a video player according to a motion control mode includes a memory that stores information necessary for operation of the device and a processor connected to the memory, wherein the processor includes: Detecting at least one signal of a tilt detection signal or an impact detection signal, determining a function of the video player in response to the detected signal, and controlling the video player in response to the determined function of the video player, The functions of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function.

The features briefly summarized above with respect to the present disclosure are merely exemplary aspects of the detailed description of the present disclosure described below, and do not limit the scope of the present disclosure.

According to the present disclosure, if it is difficult to use two hands, the video player can be operated more conveniently.

According to the present disclosure, the functions of a video player can be conveniently controlled using motion.

The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 shows a content streaming system according to an embodiment of the present disclosure.
Figure 2 shows the structure of a client device according to an embodiment of the present disclosure.
Figure 3 illustrates the concept of a content streaming service according to an embodiment of the present disclosure.
Figure 4 shows a flowchart of an operation method using a motion control mode according to an embodiment of the present disclosure.
Figure 5 illustrates the functions of a video player corresponding to a motion operation according to an embodiment of the present disclosure.
Figure 6 shows a flowchart of a method for switching to a motion control mode according to an embodiment of the present disclosure.
Figure 7 illustrates an example of switching to a motion control mode corresponding to a user's touch according to an embodiment of the present disclosure.
Figure 8 illustrates an example of switching to a motion control mode corresponding to a user's device shaking motion according to an embodiment of the present disclosure.
Figure 9 illustrates an example of switching to a motion control mode corresponding to time setting according to an embodiment of the present disclosure.
Figure 10 illustrates an example of switching to a motion control mode corresponding to tilt of the device according to an embodiment of the present disclosure.
Figure 11 shows a flowchart of a method for switching to a motion control mode according to an embodiment of the present disclosure.
Figure 12 illustrates an example of switching to a motion control mode using GPS according to an embodiment of the present disclosure.
Figure 13 illustrates an example of switching to a motion control mode corresponding to a user's WIFI (Wireless Fidelity) Access Point (AP) according to an embodiment of the present disclosure.
Figure 14 shows a flowchart of switching to a motion control mode corresponding to the user's location according to an embodiment of the present disclosure.
Figure 15 illustrates an example of switching to a motion control mode corresponding to a user's exercise state according to an embodiment of the present disclosure.
Figure 16 illustrates an example of switching to a motion control mode corresponding to the user's means of transportation according to an embodiment of the present disclosure.
Figure 17 shows an example of switching to one-hand button mode according to an embodiment of the present disclosure.
Figure 18 shows a mode switch selection message according to an embodiment of the present disclosure.
Figure 19 shows a flowchart of a method for mapping functions of a video player corresponding to a motion signal according to an embodiment of the present disclosure.
Figure 20 shows a flowchart of a function control readjustment method according to an embodiment of the present disclosure.

Hereinafter, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily practice them. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein.

In describing embodiments of the present disclosure, if it is determined that detailed descriptions of known configurations or functions may obscure the gist of the present disclosure, detailed descriptions thereof will be omitted. In addition, in the drawings, parts that are not related to the description of the present disclosure are omitted, and similar parts are given similar reference numerals.

The functional blocks shown in the drawings and described below are only examples of possible implementations. Other functional blocks may be used in other implementations without departing from the spirit and scope of the detailed description. Additionally, although one or more functional blocks of the present disclosure are shown as individual blocks, one or more of the functional blocks of the present disclosure may be a combination of various hardware and software configurations that execute the same function.

In addition, the expression including certain components is an “open” expression and simply refers to the presence of the corresponding components, and should not be understood as excluding additional components. Furthermore, when a component is referred to as being “connected” or “connected” to another component, it should be understood that although it may be directly connected or connected to the other component, other components may exist in between. something to do.

Additionally, unless the context clearly expresses otherwise, singular expressions for objects can be understood as plural expressions. In the present disclosure, expressions such as “A or B” or “at least one of A and/or B” may be understood to include all possible combinations of the items listed together. Expressions such as “first,” “second,” and “third” can modify the object regardless of order or importance, and are only used to distinguish one object from other objects of the same type.

In addition, in the present disclosure, “configured to” means “suitable for”, “having the ability to”, “changed to”, “to” in terms of hardware or software, depending on the situation. It can be understood as having a technically equivalent meaning to any of the expressions “made,” “capable of,” or “designed to,” and can be replaced with each other.

The present disclosure is intended to provide a method and device for controlling a video player according to a motion control mode in a content streaming system. Specifically, in cases where it is inconvenient to use both hands, the video player's operation mode is switched to a motion control mode so that one hand can be used. This explains techniques that allow you to manipulate the player. In particular, the present disclosure presents various embodiments regarding device operation for motion control and mode switching to a motion control mode. Here, “video player” may refer to a module that performs the function of playing video. 1 shows a content streaming system according to an embodiment of the present disclosure. Figure 1 illustrates a system for providing services related to content, such as content streaming and provision of content-related information, and entities belonging to the system. Hereinafter, in this disclosure, various services related to content may be referred to as 'content service' or other terms having equivalent technical meaning.

Referring to FIG. 1, a content streaming system may include a client device 110 and a server 120. Here, the client device 110 is illustrated as a set of three client devices 110-1 to 110-3, but the content streaming system may include two or more or four or more client devices. In addition, although the server 120 is illustrated as one, the content streaming system may include a plurality of servers that share various functions and interact with each other.

Client device 110 receives and displays content. The client device 110 may connect to the server 120 through a network and receive streaming content from the server 120. That is, the client device 110 is hardware on which client software or applications designed to use content services provided by the server 120 are installed, and can interact with the server 120 through the installed software or applications. The client device 110 may be implemented as various types of devices. For example, the client device 110 may be one of a portable device that is movable, a device that is generally movable but fixed during use, or a device that is fixedly installed in a specific location.

Specifically, the client device 110 includes a smartphone 110-1, a desktop computer 110-2, a tablet PC, a laptop PC, a netbook computer, a workstation, a server, a personal data assistant (PDA), and a portable multimedia (PMP). It may be implemented in the form of at least one of a player, a camera, or a wearable device. Here, the wearable device may be accessory type (e.g., watch, ring, bracelet, anklet, necklace, glasses, contact lens, head-mounted-device (HMD)), clothing type, body attached (e.g., skin pad or tattoo), It may be implemented in at least one form of a bioimplantable circuit. In addition, the client device 110 is a home appliance, for example, at least one of a television 110-3, a DVD (digital video disk) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, and an air purifier. It can be implemented in one form.

The server 120 performs various functions to provide content services. In other words, the server 120 can provide content streaming and various content-related services to the client device 110 using various functions. Specifically, the server 120 converts content into streaming data and transmits it to the client device 110 through a network. To this end, the server 120 may perform at least one of the following functions: encoding of content, segmentation of data, transmission scheduling, and streaming transmission. Additionally, for convenience in using content, the server 120 may further perform at least one of the following functions: providing a content guide, managing a user's account, analyzing user preferences, and recommending content based on preferences. Among the various functions described above, a plurality of functions may be provided, and for this purpose, the server 120 may be implemented with a plurality of servers.

The client device 110 and the server 120 exchange information through a network, and content services may be provided to the client device 110 based on the exchanged information. At this time, the network may be a single network or a combination of various types of networks. A network can be understood as a form in which different types of networks are connected depending on the section. For example, the networks may include at least one of a wireless network and a wired network. Specifically, the networks include 6th generation (6G), 5th generation (5G), Long Term Evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), and universal mobile (UMTS). It may include a cellular network based on at least one of (communications system), Wireless Broadband (WiMAX), or Global System for Mobile Communications (GSM). Additionally, the networks may include a local area network based on at least one of wireless local area network (WLAN), Bluetooth, Zigbee, near field communication (NFC), and ultra wideband (UWB). Additionally, networks may include wired networks such as the Internet, Ethernet, etc.

Figure 2 shows the structure of a client device according to an embodiment of the present disclosure. Figure 2 illustrates the block structure of a client device (eg, client device 110 of Figure 1).

Referring to Figure 2, the client device includes a display 202, an input unit 204, a communication unit 206, a sensing unit 208, an audio input/output unit 210, a camera module 212, a memory 214, and a power unit ( 216), an external connection terminal 218, and a processor 220. However, depending on the type of device, at least one of the components illustrated in FIG. 2 may be omitted.

The display 202 outputs information such as visually recognizable images and graphics. To this end, the display 202 may include a panel and a circuit that controls the panel. For example, panels include liquid crystal display (LCD), light emitting diode (LED), light emitting polymer display (LPD), organic light emitting diode (OLED), active matrix organic light emitting diode (AMOLED), and flexible LED (FLED). ) may include at least one of

The input unit 204 receives input generated by the user. The input unit 204 may include various types of input detection means. For example, the input unit 204 may include at least one of a physical button, a keypad, and a touch pad. Alternatively, the input unit 204 may include a touch panel. When the input unit 204 includes a touch panel, the input unit 204 and the display 202 may be implemented as one module.

The communication unit 206 provides an interface for a client device to form a network with other devices and transmit or receive data through the network. To this end, the communication unit 206 includes a circuit for physically processing signals (e.g., encoder/decoder, modulator/demodulator, RF (radio frequency) front end, etc.), and a protocol stack (e.g., a protocol stack that processes data according to communication standards). modem), etc. According to various embodiments, the communication unit 206 may include a plurality of modules to support a plurality of different communication standards.

The sensing unit 208 collects sensing data including data about the status of the client device or the surrounding environment. For example, the sensing unit 208 may measure a physical value or change in value related to the operating state or posture of the client device and generate an electrical signal representing the measured result. Additionally, the sensing unit 208 may measure physical values or changes in values in the surrounding environment of the client device and generate an electrical signal representing the measured result. To this end, the sensing unit 208 may include at least one sensor and a circuit for controlling the at least one sensor. Specifically, the sensing unit 208 includes a gyro sensor, magnetic sensor, acceleration sensor, grip sensor, proximity sensor, color sensor, biometric sensor, barometric pressure sensor, temperature sensor, humidity sensor, illuminance sensor, or UV (ultra violet sensor). ) sensor, an olfactory (e-nose) sensor, a gesture sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, and a fingerprint sensor. there is.

The audio input/output unit 210 outputs sound according to an electrical signal generated based on audio data and detects external sound. That is, the audio input/output unit 210 can convert sound and electrical signals into each other. To this end, the audio input/output unit 210 may include at least one of a speaker, a microphone, and a circuit for controlling them.

The camera module 212 collects data to create images and videos. To this end, the camera module 212 may include at least one of a lens, a lens driving circuit, an image sensor, a flash, and an image processing circuit. The camera module 212 may collect light through a lens and generate data expressing the color value and luminance value of the light using an image sensor.

The memory 214 stores operating systems, programs, applications, commands, setting information, etc. required for the client device to operate. Memory 214 may store data temporarily or non-transitorily. The memory 214 may be comprised of volatile memory, non-volatile memory, or a combination of volatile memory and non-volatile memory.

The power supply unit 216 supplies power necessary for the operation of components of the client device. To this end, the power supply unit 216 may include a converter circuit that converts power into power of a size required by each component. The power supply unit 216 may rely on an external power source or may include a battery. When including a battery, the power unit 216 may further include a circuit for charging. The circuit for charging may support wired charging or wireless charging.

The external connection terminal 218 is a physical connection means for connecting the client device with another device. For example, the external connection terminal 218 includes a universal serial bus (USB) terminal, an audio terminal, a high definition multimedia interface (HDMI) terminal, a recommended standard-232 (RS-232) terminal, an infrared terminal, an optical terminal, and a power terminal. It may include at least one of terminals of various standards, such as:

Processor 220 controls the overall operation of the client device. The processor 220 can control the operations of other components and perform various functions using the other components. For example, the processor 220 may request content data from the server through the communication unit 206 and receive the content data. Additionally, the processor 220 may restore content by decoding the received content data. Additionally, the processor 220 may output content received from the server through the display 202 and the audio input/output unit 210. In addition, the processor 220 includes at least one of the input unit 204, communication unit 206, sensing unit 208, audio input/output unit 210, camera module 212, power unit 216, and external connection terminal 218. The state related to the playback of content can be controlled based on information input or detected. To this end, the processor 220 may include at least one of at least one processor, at least one microprocessor, and at least one digital signal processor (DSP). In particular, the processor 220 may control other components and perform necessary operations so that the client device operates according to various embodiments described below.

In the structure of the client device described with reference to FIG. 2, the components are all illustrated as being connected to the processor 220. Although not shown in FIG. 2, at least some of the components may be connected through a bus. In this case, under the control of the processor 220, direct data exchange may occur between some components.

Figure 3 illustrates the concept of a content streaming service according to an embodiment of the present disclosure. FIG. 3 is a schematic diagram of some functions related to content streaming, and content streaming services according to various embodiments may further have various functions in addition to the functions illustrated in FIG. 3 .

Referring to FIG. 3, control data and content data may be transmitted and received between the client 310 and the server 320. Specifically, control data transmission from the client 310 to the server 320, control data transmission from the server 320 to the client 310, and content data transmission from the server 320 to the client 310 may be performed.

The server 320 stores user information 322a, content information 322b, and content database (DB) 322c. The user information 322a may include users' account information, information about users' service use history, and information about users' preferences. The content information 322b may include a list of serviceable content, content guide information, content meta information, and information on content consumption history. The content DB 322c may include content stored in a data format. In addition, the server 320 may further store other information necessary to provide services.

Control data from the client 310 to the server 320 may include information about user log-in, information about the user's content selection, and information about the user's content control. To this end, the client 310 may generate and transmit control data from user input through the user input processing operation 301. Control data from the client 310 is processed through control/management operations 303 and used to provide content. For example, control/management operations 303 may select control data and/or content based on control data from client 301. Additionally, preferences can be determined by analyzing the user's consumption history and behavior through the control/management operation 303, and content to be recommended can be selected according to the determined preferences.

The procedure by which content is provided to the user is as follows with reference to FIG. 3. First, the client 310 generates control data including login information (eg, ID and password) input by the user through a user input processing operation 301 and transmits the control data. The server 320 can determine whether the user is a valid user by searching the user information 322a for the login information included in the control data from the client 310, and determine the scope of content and services allowed according to the user's permissions. there is. However, if login is not required or limited services that can be provided without login are supported, transmission and processing of login information may be omitted.

Next, the server 310 extracts content guide information from the content information 322b through a control/management operation 303 and transmits control data including the content guide information to the client 310. The client 310 outputs content guide information included in the control data and confirms the user's selection. The user's selection is transmitted to the server 310 as control data through the user input processing operation 301. Information about the user's selection is processed by the control/management operation 303 and used to select content to be streamed. The server 320 searches for the selected content in the content DB 322, compresses and segments the searched content through an encoding operation 307, and then transmits the content data. Content data may be compressed in advance through an encoding operation 307 and stored. Here, the encoding operation 307 may include not only compressing the original content image, but also decoding the content data generated through compression and then compressing it again. At this time, compression may be performed based on the resolution, bit rate, and number of frames per second of the content image. When stored in a pre-compressed manner, the compression operation is omitted, and the server 320 can perform segmentation on the content data. Content data may be restored through a decoding operation 309 and provided to the user through a playback operation 311. At this time, for compression, at least one of various video codecs and various audio codecs may be used. For example, various video codecs include Moving Picture Experts Group-2 (MPEG-2), H.264 Advanced Video Coding (AVC), H.265 High Efficiency Video Coding (HEVC), and H.266 Versatile video coding (VVC). , VP8 (Video Processor 8), VP9 (Video Processor 9), AV1 (AOMedia Video 1), DivX, Xvid, VC-1, Theora, and Daala.

Audio codecs include MP3 (MPEG 1 Audio Layer 3), AC3 (Dolby Digital AC-3), E-AC3 (Enhanced AC-3), AAC (Advanced Audio Coding, MPEG 2 Audio), FLAC (Free Lossless Audio Codec), This may include High Efficiency Advanced Audio Coding (HE-AAC), OGG Vorbis, and OPUS.

A content video may be compressed according to various resolutions, bit rates, and frames per second of the video, and a plurality of content data may be generated in advance. The client 310 may measure throughput (or bandwidth) and determine a bit rate based on the measured throughput (or bandwidth).

The client 310 may receive information about a plurality of content data from the server 320. The received information may include information indicating the bit rate, resolution, number of frames per second, and location of the plurality of content data.

The client 310 determines at least one content data among the plurality of content data based on the bit rate, and the playable resolution and number of frames per second among the at least one content data based on the capability information of the client 310. Playback content data and its location corresponding to can be determined. At this time, the capability information may include, but is not limited to, the maximum supported resolution and maximum number of supported frames of the client.

The client 310 may transmit a content request to the server 320 based on the location of the playback content data. The server 320 may transmit content data corresponding to the content request to the client 310 based on the received content request.

According to another embodiment, the client 310 receives user input regarding at least one of the resolution of the image and the number of frames per second, determines playback content data and its location according to the user input, and requests content to the server 320. can be transmitted.

Figure 4 shows a flowchart of an operation method using a motion control mode according to an embodiment of the present disclosure. FIG. 4 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

Referring to FIG. 4, in step S401, the device can detect a signal. Specifically, the device can detect motion signals. Here, the motion signal is a signal generated by a change in the physical posture of the device or the application of a physical force, and is generated by at least one sensor included in the device. For example, the motion signal is related to acceleration and azimuth (e.g. Yaw, Pitch, Roll) in three axes (e.g. It can contain one. Additionally, the tilt detection signal of the device may include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, and an upper rotation signal of the device. Details of the tilt detection signal will be described later with reference to FIG. 5. In the present disclosure, detection of a motion signal is an operation of recognizing motion by a signal generated by a sensor, and can be understood to have the same meaning as 'detection of motion.'

In step S402, the device may determine the function of the video player. Specifically, the device can determine which function of the video player and how to adjust it in response to the signal detected in step S401. That is, based on the mapping relationship of the functions of the video player for each detection signal predefined by the user, the device can determine which function of the video player and how to control it. Here, the function of the video player may include at least one of a volume control function (volume up/down), a brightness control function (brightness up/down), a play/stop function, or a fast forward/rewind function, and the present disclosure relates to this. It is not limited. According to one embodiment, the device may determine the function to be adjusted based on the rotation represented by the sensed signal (e.g., rotation about a certain axis of tilt).

In step S403, the device can control the video player. Specifically, the device can control the function of the video player determined in step S402. For example, in step S402, when it is decided whether to increase or decrease the volume, the device may control the volume (e.g., volume up or down) in response to the decision.

According to one embodiment, the device may determine the content of adjustment (e.g., item to be adjusted, degree of adjustment, etc.) based on the direction of rotation, tilt, or degree of tilt expressed by the detected signal. For example, when the degree of inclination is greater than a predetermined value, the unit of time for moving forward (e.g., 10 seconds) is the unit of time for moving forward when the degree of inclination is less than a predetermined value (e.g., 5 seconds). It can be bigger than

In the procedure for controlling the functions of the video player according to the above-described embodiment, the device may detect various movements of the device. Here, movement of the device includes tilt of the device. The tilt detection signal may be generated by a gyroscope. Here, the gyroscope is a sensor that can detect rotational movement. According to an embodiment of the present disclosure, the tilt detection signal generated by the gyroscope may include a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, or an upper rotation signal. Here, the right rotation signal may refer to a signal generated when the device rotates to the right around the central vertical line. Additionally, the left rotation signal may refer to a signal generated when the device rotates to the left around the central vertical line (e.g., X-axis or Y-axis). The right tilt signal may refer to a signal generated when the device rotates clockwise based on an axis (e.g., Z-axis) that crosses the exact center of the device from the front to the back. The left tilt signal may refer to a signal generated when the device rotates counterclockwise based on an axis (e.g., Z-axis) that crosses the exact center of the device from the front to the back. The downward rotation signal may refer to a signal generated when the device rotates downward about the central horizontal line (e.g. Y-axis or X-axis). The upper rotation signal may refer to a signal generated when the device rotates upward about the central horizontal line.

The impact detection signal of the device according to an embodiment of the present disclosure may be generated by an acceleration sensor. Here, the acceleration sensor serves to measure dynamic forces such as acceleration, vibration, and shock of the device. Specifically, according to an embodiment of the present disclosure, when an impact is applied to the device, an acceleration sensor inside the device may generate an impact detection signal by detecting a change in speed per unit time. Afterwards, the device can determine and control the function of the video player in response to the impact detection signal received from the acceleration sensor. That is, based on the function of the video player for each detection signal pre-mapped by the user, the device can determine which function of the video player to control and control the function of the video player accordingly.

Figure 5 illustrates the functions of a video player corresponding to a motion operation according to an embodiment of the present disclosure.

According to the present disclosure, a user can arbitrarily set a function of a video player corresponding to at least one of a tilt detection signal or an impact detection signal. For example, when a right turn signal is detected, the user can set the device to increase the volume of the video player. As another example, when a right turn signal is detected, the user can set the device to increase the brightness of the video player, but the present disclosure is not limited to this. Referring to FIG. 5 , when detecting a right turn signal 501, the device can increase the volume of the video player, and when detecting a left turn signal 502, the device can lower the volume. Additionally, when detecting the right tilt signal 503, the device can fast-forward the video (e.g., move forward 5 seconds), and when detecting the left tilt signal 504, the device can rewind the video (e.g., move forward 5 seconds). You can move back 5 seconds). And, when detecting the upper rotation signal 505, the device can brighten the brightness of the image (e.g., increase brightness by 2%), and when detecting the lower rotation signal 506, the device can darken the brightness of the image. (Example: Decrease brightness by 2%). In addition, if an impact 507 of a certain size or larger is detected while the video is being played, the device can stop the video. If an impact 507 of a certain size or more is detected while the video is stopped, the device can play the video. It can be played again. The embodiment according to the present disclosure is not limited to this, and the user can variously map the functions of the video player corresponding to the tilt detection signal or the impact detection signal. Hereinafter, the detailed mapping method is described in FIG. 19.

Figure 6 shows a flowchart of a method for switching to a motion control mode according to an embodiment of the present disclosure. FIG. 6 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

Referring to FIG. 6, in step S601, the device may receive a mode switch request. At this time, the mode switch request may be generated by the user's action. Here, the mode switch request may be generated based on at least one of the user's touch input, device shaking motion, time setting, or device tilting motion. The user's touch input, which is one of the mode change requests, may be an action in which the user presses the user interface of the device for more than a certain period of time (eg, a long press action), and the present disclosure is not limited to this. Additionally, device shaking motion and device tilting motion may be detected by a gyroscope or tilt sensor and a corresponding mode switch request signal may be generated. And, time setting may mean a time arbitrarily designated according to the user's request.

In step S602, the device may switch operation modes. Specifically, when a mode switch request according to S601 is received, the device may switch the operation mode accordingly. Here, the operation mode may be a motion control mode or a one-hand button mode. The motion control mode refers to a mode in which the functions of the video player can be adjusted according to the device's tilt detection signal or impact detection signal. Additionally, the one-hand button mode refers to a mode that provides a user interface with a changed location so that buttons can be pressed using one hand. A more specific one-hand button mode will be described later using FIG. 17.

In step S603, the device whose operation mode has been switched to the motion control mode can detect a signal. Specifically, the device can detect motion signals. Here, the motion signal is a signal generated by a change in the physical posture of the device or the application of physical force, and is generated by a sensor included in the device. For example, the motion signal is related to acceleration, azimuth, etc., and may specifically include at least one of a tilt detection signal or an impact detection signal of the device. Additionally, the tilt detection signal of the device may include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, and an upper rotation signal of the device. In the present disclosure, detection of a motion signal is an operation of recognizing motion by a signal generated by a sensor, and can be understood to have the same meaning as 'detection of motion.'

In step S604, the device may determine the function of the video player. Specifically, the device can determine which function of the video player and how to adjust it in response to the signal detected in step S603. That is, based on the mapping relationship between the functions of the video player for each detection signal predefined by the user, the device can determine which function of the video player and how to control it. Here, the function of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function, but the present disclosure is not limited thereto. According to one embodiment, the device may determine the function to be adjusted based on the rotation represented by the sensed signal (e.g., rotation about a certain axis of tilt).

In step S605, the device can control the video player. Specifically, the device can control the function after determining how to control the function of the video player determined in step S604. For example, in step S604, when it is decided whether to increase or decrease the volume, the device may control the volume (e.g., volume up or down) in response to the decision.

According to one embodiment, the device may determine the content of adjustment (e.g., item to be adjusted, degree of adjustment, etc.) based on the direction of rotation, tilt, or degree of tilt expressed by the detected signal. For example, when the degree of inclination is greater than a predetermined value, the unit of time for moving forward (e.g., 10 seconds) is the unit of time for moving forward when the degree of inclination is less than a predetermined value (e.g., 5 seconds). It can be bigger than

Figure 7 illustrates an example of switching to a motion control mode corresponding to a user's touch according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, a device can switch the operating mode by receiving a user's mode switching request. Referring to FIG. 7, the device can switch to the motion control mode by the user's touch input, which is one of the user's mode switch requests. Here, the user's touch input may be an input in which the user presses the interface of the device for a certain period of time (eg, 2 seconds) or more. For example, when the user presses one of the buttons included in the video player operation interface 703 (e.g., a rewind button, a play button, or a fast forward button) for more than a certain period of time, the device switches to the motion control mode (701) It can be. In addition, when one of the buttons included in the video player operation interface 703 (e.g., rewind button, play button, or fast forward button) is pressed for more than a certain period of time while the device is switched to motion control mode, the device returns to the previous position. The mode (e.g., default control mode) may be returned (702). According to another embodiment of the present disclosure, when a user requests a mode switch, a message asking for the intention to switch the mode may be displayed on the display of the device. At this time, when the device receives a mode change request, the user can set whether to display a message asking for the user's intention.

Figure 8 illustrates an example of switching to a motion control mode corresponding to a user's device shaking motion according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, a device can switch the operating mode by receiving a user's mode switching request. The device can be switched to the motion control mode by shaking the device, which is one of the user's mode switch requests. Here, the user's device shaking motion may be detected by a gyroscope or tilt sensor. Referring to FIG. 8, when the user shakes the device 803, the operation mode of the device may be switched to the motion control mode (801). Additionally, if the user shakes the device again while the operation mode has been switched to the motion control mode, the operation mode of the device may return to the previous mode (eg, default control mode) (802). Additionally, according to an embodiment of the present disclosure, the user can set the number of times to shake the device for switching the operation mode to the motion control mode. By setting the number of times the user shakes the device, errors caused by natural shaking in daily life can be reduced. According to another embodiment of the present disclosure, when a user requests a mode switch, a message asking for the intention to switch the mode may be displayed on the display of the device. At this time, the user can set whether to display a message asking for the intention to switch to the motion control mode.

Figure 9 shows an embodiment of switching to a motion control mode corresponding to time settings.

According to one embodiment of the present disclosure, a device can switch the operating mode by receiving a user's mode switching request. The device can be switched to the motion control mode by setting the time, which is one of the user's mode switch requests. Specifically, the motion control mode may be switched at a time preset by the user. For example, if the user wants to switch to the motion control mode during rush hour, the user can set a time so that the device switches to the motion control mode at that time. Accordingly, when the time set by the user arrives, the device can automatically switch the operation mode to the motion control mode (901). Additionally, when the time set by the user elapses, the device may automatically return to the previous mode (eg, default control mode) (902). According to another embodiment of the present disclosure, when the time set by the user arrives, a message asking for the intention to switch modes may be displayed on the display of the device. At this time, the user can set whether to display a message asking for the intention to switch to the motion control mode. Additionally, after a time set by the user has elapsed, the device may display a message on the display asking whether to return to the default control mode.

Figure 10 shows an embodiment of switching to a motion control mode corresponding to tilting of the device.

According to one embodiment of the present disclosure, a device can switch the operating mode by receiving a user's mode switching request. The device can switch its operation mode to the motion control mode by tilting the device, which is one of the user's mode switch requests. Referring to Figure 10, when a user tilts the device in a specific direction, the gyroscope inside the device can detect this. When the gyroscope detects rotation of the device, a tilt signal of the device may be generated by the gyroscope. Accordingly, after the device receives the tilt signal, it can switch the operation mode to the motion control mode (1001). At this time, the tilting direction of the device can be arbitrarily set by the user. For example, when the user rotates in the right tilt rotation direction, the operation mode can be set to be switched to the motion control mode, but the embodiment of the present disclosure is not limited to this. Additionally, if the user tilts the device in a specific direction while switched to the motion control mode, the device may return to the previous mode (eg, default control mode) (1002). Even in this case, the user can arbitrarily set the tilt direction of the device to return to the default control mode. For example, the tilt direction may be opposite to the tilt direction for switching to the motion control mode.

Figure 11 shows a flowchart of a method for switching to a motion control mode according to an embodiment of the present disclosure. FIG. 11 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

Referring to FIG. 11, in step S1101, the device may receive the user's status information. Here, the user's status information may include information about at least one of the user's location, the user's exercise status, or the user's means of transportation. Information about the user's location, which is one of the user's status information, may be determined by a Global Positioning System (GPS) signal or an identifier of an Access Point (AP) of a wireless network. Additionally, information about the user's exercise state may be determined by the user's heart rate signal, GPS signal, etc. Additionally, information about the user's means of transportation can be determined by GPS signals.

In step S1102, the device may switch operation modes. Specifically, when the device receives the user's status information according to S1101, it can switch the operation mode accordingly. Here, the operation mode to be switched may be a motion control mode or a one-hand button mode. Motion control mode means that the functions of the video player can be adjusted according to the device's tilt detection signal or impact detection signal. Additionally, the one-hand button mode refers to a mode that provides a user interface with a changed location so that buttons can be pressed using one hand. A more specific one-hand button mode will be described later using FIG. 17.

In step S1103, the device whose operation mode has been switched to the motion control mode can detect a signal. Specifically, the device can detect motion signals. Here, the motion signal is a signal generated by a change in the physical posture of the device or the application of physical force, and is generated by a sensor included in the device. For example, the motion signal is related to acceleration, azimuth, etc., and may specifically include at least one of a tilt detection signal or an impact detection signal of the device. Additionally, the tilt detection signal of the device may include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, and an upper rotation signal of the device. In the present disclosure, detection of a motion signal is an operation of recognizing motion by a signal generated by a sensor, and can be understood to have the same meaning as 'detection of motion.'

In step S1104, the device may determine the function of the video player. Specifically, the device can determine which function of the video player and how to adjust it in response to the signal detected in step S1103. That is, based on the mapping relationship between the functions of the video player for each detection signal predefined by the user, the device can determine which function of the video player and how to control it. Here, the function of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function, but the present disclosure is not limited thereto. According to one embodiment, the device may determine the function to be adjusted based on the rotation represented by the sensed signal (e.g., rotation about a certain axis of tilt).

In step S1105, the device can control the video player. Specifically, the device can control the function after determining how to control the function of the video player determined in step S1104. For example, in step S1104, when it is decided whether to increase or decrease the volume, the device may control the volume (e.g., volume up or down) in response to the decision.

Figure 12 shows an example of switching to a motion control mode using a GPS signal according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, when the user is within a specific location range, the device 1202 may automatically switch the operation mode to the motion control mode (1203). Additionally, if the user leaves a specific location range, the device 1202 may automatically return the operating mode to a previous mode (e.g., default control mode) (1204). According to another embodiment of the present disclosure, when the user leaves a specific location range, the device 1202 may automatically switch the operation mode to the motion control mode (1203). At this time, the specific location range can be arbitrarily designated by the user. According to another embodiment of the present disclosure, when the device 1202 is within a specific location range, a message asking for the intention to switch modes may be displayed on the display of the device 1202. At this time, the user can set whether to display a message asking for the intention to switch to the motion control mode. The user's location may be determined by GPS signals. Specifically, referring to FIG. 12, the device 1202 receives a signal transmitted by the GPS satellite 1201, acquires location information of the device 1202, and operates in a motion control mode using the obtained location information. You can decide whether to switch or not.

Figure 13 illustrates an example of switching to a motion control mode corresponding to a user's WIFI AP according to an embodiment of the present disclosure.

According to an embodiment of the present disclosure, when a user is connected to a specific WIFI AP 1301, the device 1202 may automatically switch the operation mode to the motion control mode (1303). Additionally, when the user is connected to and then disconnected from a specific WIFI AP (1301), the device (1202) may automatically return the operation mode to the previous mode (e.g., default control mode) (1304). According to another embodiment of the present disclosure, when the user is connected to and then disconnected from a specific WIFI AP 1301, the device 1202 may automatically switch the operation mode to the motion control mode (1303). According to another embodiment of the present disclosure, when the device 1202 is connected to a specific WIFI AP 1301, the device 1202 may display a message asking for intention to switch modes on the display. At this time, the user can set whether to display a message asking for the intention to switch to the motion control mode.

Figure 14 shows a flowchart of switching to a motion control mode corresponding to the user's location according to an embodiment of the present disclosure. FIG. 14 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

Referring to FIG. 14, in step S1401, a device (eg, client device 110 of FIG. 1) may obtain location information of the device. For example, the device may acquire location information of the device by receiving a signal transmitted from a GPS satellite. As another example, when a device is connected to a specific WIFI AP, the device can receive location information of the WIFI AP.

In step S1402, the device can check whether the user's location is within a set location range. If the user's location is within the set location range, step S1403 can be performed. That is, the device can switch the operation mode to the motion control mode. At this time, the range of the position converted to motion control mode can be arbitrarily set by the user.

In step S1404, the device whose operation mode has been switched to the motion control mode can detect a signal. Specifically, the device can detect motion signals. Here, the motion signal is a signal generated by a change in the physical posture of the device or the application of physical force, and is generated by a sensor included in the device. For example, the motion signal is related to acceleration, azimuth, etc., and may specifically include at least one of a tilt detection signal or an impact detection signal of the device. Additionally, the tilt detection signal of the device may include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, and an upper rotation signal of the device. In the present disclosure, detection of a motion signal is an operation of recognizing motion by a signal generated by a sensor, and can be understood to have the same meaning as 'detection of motion.'

In step S1405, the device may determine the function of the video player. Specifically, the device can determine which function of the video player and how to adjust it in response to the signal detected in step S1404. That is, based on the mapping relationship between the functions of the video player for each detection signal predefined by the user, the device can determine which function of the video player and how to control it. Here, the function of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function, but the present disclosure is not limited thereto. According to one embodiment, the device may determine the function to be adjusted based on the rotation represented by the sensed signal (e.g., rotation about a certain axis of tilt).

In step S1406, the device can control the video player. Specifically, the device can control the function after determining how to control the function of the video player determined in step S1405.

Figure 15 illustrates an example of switching to a motion control mode corresponding to a user's exercise state according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, according to the user's exercise state, the device 1202 may automatically switch the operation mode to the motion control mode (1501). Specifically, the device 1202 may determine that the user is walking using an acceleration sensor. Accordingly, when it is determined that the user is walking, the device 1202 may automatically switch the operation mode to the motion control mode (1501). Additionally, when it is determined that the user is in a stopped or sitting state, the device 1202 may return the operating mode to the default mode (1502). According to another embodiment of the present disclosure, the device 1202 may determine the user's exercise state through a pedometer function (step measurement function) based on an acceleration sensor. In this case, if it is determined that the user is walking, the device 1202 may automatically switch the operation mode to the motion control mode (1501), and if it is determined that the user is in a stopped or sitting state, the device 1202 may operate. The mode can be returned to the default control mode (1502). According to another embodiment of the present disclosure, it may be possible to determine that the user is walking using a GPS signal, but the present disclosure is not limited to this.

According to another embodiment of the present disclosure, when it is determined that the user is walking, the device 1202 may display a message asking the user's intention to switch modes on the display. At this time, the user can set whether to display a message asking for the intention to switch modes.

Figure 16 illustrates an example of switching to a motion control mode corresponding to the user's means of transportation according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, according to the user's current means of transportation, the device 1202 may automatically switch the operation mode to the motion control mode (1601). Specifically, the device 1202 may determine the user's means of transportation using an acceleration sensor or GPS signal. Additionally, the device 1202 may determine the user's means of transportation based on changes in GPS signals over time. Additionally, the device 1202 can determine the user's means of transportation by receiving a signal transmitted from a beacon installed within the means of transportation.

For example, if it is determined that the user is using a means of transportation such as a subway or bus, the device 1202 may automatically switch the operation mode to the motion control mode (1601). Additionally, if it is determined that the user is in a stationary state, the device 1202 may automatically return the operation mode back to the default control mode (1602). According to another embodiment of the present disclosure, when it is determined that the user is using a means of transportation, the device 1202 may display a message asking the user's intention to switch modes on the display. Additionally, when it is determined that the user is in a stationary state, the device 1202 may display a message asking for intent to return to the default control mode on the display. At this time, the user can set whether to display a message asking for intention to switch modes.

Figure 17 shows an example of switching to one-hand button mode according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, operation modes for the video player of the device may include a default control mode, a motion control mode, and/or a one-hand button mode. Here, the default control mode is a mode that provides the default interface of the video player, and may refer to a mode that controls the functions of the video player through the default interface. One-hand button mode may refer to a mode that provides a user interface with a changed location so that buttons can be pressed using one hand. Referring to FIG. 17, when the user presses the rewind button or the fast forward button in the video manipulation interface 1703 of the video player for more than a certain period of time, the operation mode may be switched to one-hand button mode (1701). For example, when the user presses the rewind button for more than a certain period of time, the image manipulation interface 1704 may be located at the bottom left of the device display. Additionally, when the user presses the fast forward button for more than a certain period of time, the image manipulation interface 1705 may be located at the lower right corner of the device display. The image manipulation interface 1704 is not limited to being located at the bottom left, and according to another embodiment of the present disclosure, it is located adjacent to the left corner (e.g., center left or top left) so that the user can touch it using the left hand. ) can be located. Likewise, the image manipulation interface 1704 may be located adjacent to the right corner (e.g., in the center right or top right).

Additionally, when at least one button of the video manipulation interface (1704, 1705) is pressed for a certain period of time while the device is switched to one-hand button mode, the device returns to the previous mode (e.g., default control mode) (1702). It can be.

Figure 18 shows a mode switch selection message according to an embodiment of the present disclosure.

According to one embodiment of the present disclosure, when the user presses the rewind button or the fast forward button of the video manipulation interface for more than a certain period of time, the device may display a message on the display for selecting which mode to switch to. In this case, the user can select the desired mode in the message and switch the operation mode to the desired mode. According to another embodiment of the present disclosure, according to the user's settings, when the image manipulation button is pressed for a certain period of time, the operation mode is converted to the one-hand button mode, and the operation mode is converted to the motion control mode by shaking the device or tilting the device. It could be. That is, the user can arbitrarily set which operation mode to switch to according to the user's mode change request operation and the operation, and the present disclosure is not limited to this.

According to an embodiment of the present disclosure, a user can variously map functions of a video player corresponding to a motion signal. Here, the motion signal may be a tilt detection signal or an impact detection signal. To this end, the device may provide a function to set the mapping relationship between the motion signal and the function control of the video player according to the user's command. The procedure for setting the mapping relationship between the motion signal and the video player's function control is as follows.

Figure 19 shows a flowchart of a method for mapping functions of a video player corresponding to a motion signal according to an embodiment of the present disclosure. FIG. 19 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

In step S1901, the device may display an interface for settings. Specifically, the device may display an interface for setting the mapping relationship so that the user can define the mapping relationship of the video player function for each detection signal. At this time, the display of the interface for settings may be performed upon the user's request. Here, the user's request may include a click on the settings screen of the device display or a user's request through voice recognition, but the present disclosure is not limited thereto. In the present disclosure, the interface for settings can be understood to have the same meaning as 'setting screen'.

In step S1902, the device can check motion signal information selected by the user. Specifically, the user can select a motion signal to be used in the motion control mode through the interface displayed in step S1901. Accordingly, the device can check information about the motion signal selected by the user. In other words, when the user selects which motion signal he or she wants to map the function of the video player to on the device's settings screen, the device can check which motion signal the user has selected. Here, the motion signal is a signal generated by a change in the physical posture of the device or the application of physical force, and may be generated by a sensor included in the device. For example, the motion signal is related to acceleration, azimuth, etc., and may specifically include at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, an upper rotation signal, or an impact signal of the device. You can.

In step S1903, the device can check function information of the video player selected by the user. Specifically, the user can select a function of the video player to be controlled in response to the motion signal selected in step S1902. In other words, when the user selects a video player function on the device's settings screen, the device can check what the user's selected video player function is. Accordingly, the device can check the function information of the video player selected by the user along with the motion signal information confirmed in step S1902. Here, the function of the video player may include at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function.

In step S1904, the device can check function control information of the video player selected by the user. Specifically, the user can choose how to adjust the functions of the video player selected in step S1903. That is, when the user selects how to control the function of the video player on the device's settings screen, the device can check the function control information of the video player selected by the user. Accordingly, the device can check the function control information of the video player selected by the user along with the information confirmed in steps S1902 and S1903.

In step S1905, the device can be set to control the function of the video player based on the confirmed motion signal information. That is, the device can set how to control which function in response to which signal using each information confirmed in steps S1902, S1903, and S1904. For example, if the user selects the right turn signal of the device in step S1902, selects the volume control function in step S1903, and selects the control to increase the volume in step S1904, the device adjusts the volume when the right turn signal is detected. You can set it to increase. The present disclosure is not limited to this, and may be mapped into various combinations by the user.

According to an embodiment of the present disclosure, a motion signal sensitivity test and a weight modification procedure may be performed. In some cases, the function of the video player mapped by the user may not be performed accurately. In this case, in order to perform the function more accurately, the device can test the motion signal sensitivity and modify the weight during the mapping process of the video player function. More specifically, after step S1904, the device may perform a test for motion signal sensitivity and a weight modification step. Here, motion signal sensitivity may refer to the accuracy and/or sensitivity of video player control corresponding to the motion signal. The test step for motion signal sensitivity may be a step to check whether the function of the video player corresponding to the motion signal mapped by the user is accurately performed. For example, if the user sets the volume to increase in response to a right turn signal, the device may provide a test interface so that the user can perform a right turn motion. Accordingly, the device can check whether the volume increases as the user performs a right rotation motion. Additionally, the device may perform a weight modification step based on the test step. More specifically, if it is recognized that an error has occurred in the user's motion signal as a result of performing the test step, the device can adjust the error by modifying the weight. Here, the weight may be a value given to the motion signal according to the tilt (or rotation) direction and/or degree of tilt (tilt) along the tilt axis. For example, the weight may be set in response to a right-turn motion and a specific tilt, but may be modified in response to a tilt that is less than the specific tilt. In other words, by modifying the weight, the video player can be controlled even with a small tilt. Alternatively, if the reference rotation direction (e.g. right rotation direction) is different from the rotation direction (upper right rotation direction) of the motion movement actually performed by the user, modify the weight for the upper rotation direction or modify the weight for the right rotation direction. By doing so, the video player can be controlled in response to the motion actually performed by the user. Here, the error may be the difference between the reference motion signal and the tilt difference value and/or tilt axis (or rotation direction according to the tilt axis) between the motion motion actually performed by the user, but the present disclosure is not limited thereto.

According to an embodiment of the present disclosure, the function of a video player corresponding to a motion operation can be updated. That is, if the function of the video player controlled in response to a specific motion operation is different from what the user wants, the device can update the function of the video player corresponding to the motion operation by recognizing this. The procedure for updating the mapping relationship between the motion operation and the function control of the video player may be as follows.

Figure 20 shows a flowchart of a function control readjustment method according to an embodiment of the present disclosure. FIG. 20 illustrates a method of operating a device executing a video player (eg, the client device 110 of FIG. 1).

Referring to FIG. 20, in step S2001, the device may recognize the occurrence of a readjustment situation of function control. Here, a situation in which function control is readjusted may mean a situation in which a function other than the function intended by the user is controlled and the user cancels the controlled function and re-controls the desired function. In other words, the function of the video player was controlled in response to the motion signal detected by the device, but the user canceled the function of the video player controlled within a certain time (hereinafter, the first threshold) and within a certain time (hereinafter, the second threshold). If the function of another video player is directly controlled, the device may recognize that a situation of readjustment of function control has occurred. If this situation of readjustment of functional control occurs repeatedly, the AI model may recognize the need to update the mapping relationship between motion and functional control. A more specific method of recognizing the occurrence of a readjustment situation of function control will be described later.

In step S2002, the device can confirm the performed and intended controls. Specifically, the device can determine what control the device actually performed. Additionally, the control intended by the user can be confirmed. Here, the control intended by the user can be confirmed through the readjustment status of the function control confirmed in step S2001. More specifically, if the user cancels the function of the video player controlled by the actual device and directly controls the function of another video player within a certain period of time, the user's intended control can be confirmed by checking the directly controlled function. . Here, canceling the function controlled by the actual device may mean that the user controls the function to return to the state just before the function of the video player was controlled by the actual device.

In step S2003, the device may update the mapping relationship between the motion signal and the function control. Specifically, after confirming the control performed and the intended control in step S2002, the device may update the function control of the video player mapped to the motion signal performed by the user to the intended control. For example, if the user sets the video player function in response to the right turn signal to volume control, but the device adjusts the brightness due to the user's device operation habits, the device may recognize this as a situation where the video player function control has been readjusted. You can. At this time, the device can check the brightness control function, which is the control actually performed, and the volume control function, which is the control intended by the user. Afterwards, the device can update the mapping relationship between the corresponding motion and function controls. Accordingly, the present disclosure can increase the accuracy of the motion control mode.

In the embodiment described with reference to FIG. 20, the device may update the mapping relationship between the motion signal and the function control in response to the occurrence of a readjustment situation of the function control. However, immediately updating the mapping relationship between motion signals and function controls according to the occurrence of a situation may go against the user's will. Therefore, according to another embodiment of the present disclosure, the device may perform a procedure to ask the user's intention before updating the mapping relationship between the motion signal and the function control. In other words, the device can confirm the user's intention by displaying a message asking for the user's intention on the screen. Accordingly, the device can update the mapping relationship only when the user wants to update the mapping relationship.

In the embodiment described with reference to FIG. 20, a method for the device to recognize the occurrence of a readjustment situation of function control is as follows. First, the device can check whether the user cancels the function within a certain period of time after controlling the function of the video player corresponding to the motion signal. At this time, the device can set a first threshold for a certain time. Here, the first threshold may be the time it takes for the function to be canceled by the user after the video player function is controlled by the device. For example, if the user cancels a function within a first threshold set by the device, the device may perform a procedure to determine whether readjustment of function control is necessary. The procedure to check whether readjustment of function control is necessary is to check whether other functions were directly controlled within a certain period of time after the user canceled the function. At this time, the device can set a second threshold for a certain period of time. Here, the second threshold may be the time it takes for the user to directly control the function after canceling the function by the user. For example, if the user directly controls a function within the second threshold set by the device, the device may recognize that a situation of readjustment of function control has occurred. If this situation of readjustment of functional control occurs repeatedly, the AI model may recognize the need to update the mapping relationship between motion and functional control. Accordingly, the device can confirm the control performed by the device and the control intended by the user, and update the mapping relationship between motion and function control.

According to another embodiment of the present disclosure, if the function of the video player corresponding to the motion operation is not mapped, the device may suggest the function of the video player corresponding to the specific motion operation using the learned AI model. More specifically, the device can recognize a situation where the user performs a specific motion operation for which no function is mapped and directly adjusts the function of the video player within a certain period of time. If this situation occurs repeatedly, the device may suggest mapping the function of the video player adjusted by the user in response to the corresponding motion operation. In this case, the device may display information suggesting a mapping relationship on the device display.

According to another embodiment of the present disclosure, if the user repeatedly adjusts the function of the same video player at a specific location, the device may recognize this and then suggest mapping the function of the video player adjusted by the user in response to the location. there is. According to another embodiment of the present disclosure, if the user repeatedly adjusts the function of the same video player at a specific time, the device recognizes this and proposes to map the function of the video player adjusted by the user in response to that time. You can.

Exemplary methods of the present disclosure are expressed as a series of operations for clarity of explanation, but this is not intended to limit the order in which the steps are performed, and each step may be performed simultaneously or in a different order, if necessary. In order to implement the method according to the present disclosure, other steps may be included in addition to the exemplified steps, some steps may be excluded and the remaining steps may be included, or some steps may be excluded and additional other steps may be included.

The various embodiments of the present disclosure do not list all possible combinations but are intended to explain representative aspects of the present disclosure, and matters described in the various embodiments may be applied independently or in combination of two or more.

Additionally, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. For hardware implementation, one or more ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), DSPDs (Digital Signal Processing Devices), PLDs (Programmable Logic Devices), FPGAs (Field Programmable Gate Arrays), general purpose It can be implemented by a processor (general processor), controller, microcontroller, microprocessor, etc.

The scope of the present disclosure is software or machine-executable instructions (e.g., operating system, application, firmware, program, etc.) that cause operations according to the methods of various embodiments to be executed on a device or computer, and such software or It includes non-transitory computer-readable medium in which instructions, etc. are stored and can be executed on a device or computer.

Claims (12)

In a method of controlling a video player according to a motion control mode,
Detecting at least one of a tilt detection signal or an impact detection signal of the device;
determining a function of the video player in response to the detected signal; and
Comprising: controlling the video player in response to the determined function of the video player,
The function of the video player includes at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function.
In claim 1,
Detecting a user's request to switch modes; and
The method further comprising switching the operation mode of the video player to the motion control mode in response to the user's mode change request.
In claim 2,
The method wherein the user's request for mode switching corresponds to at least one of the user's touch input, device shaking motion, or time setting.
In claim 3,
The method wherein the user's touch input is a touch input for a certain period of time or more on a rewind item or a fast forward item among video manipulation items included in the user interface of the video player.
In claim 1,
The tilt detection signal includes at least one of a right rotation signal, a left rotation signal, a right tilt signal, a left tilt signal, a lower rotation signal, and an upper rotation signal of the device.
In claim 5,
A function of the video player corresponding to at least one of the tilt detection signal or the impact detection signal is set by a user.
In claim 1,
Receiving user status information; and
A method comprising switching the operation mode of the video player to the motion control mode in response to the user's status information.
In claim 7,
The method wherein the user's status information includes information about at least one of the user's location, the user's exercise state, or the user's means of transportation.
In claim 8,
The method of claim 1, wherein the information regarding the user's location is determined by a Global Positioning System (GPS) signal or an identifier of an access point of a wireless network.
In claim 8,
The method, wherein information about the user's exercise state or the user's means of transportation is detected by at least one of a gyroscope, an acceleration sensor, or a GPS sensor inside the device.
In claim 1,
Recognizing that a situation of readjustment of functional control has occurred;
confirming the control actually performed by the device and the control intended by the user; and
A method comprising updating a mapping relationship between motion signals and functional controls.
In a device that controls a video player according to a motion control mode,
a memory that stores information necessary for operation of the device; and
Includes a processor connected to the memory,
The processor,
Detect at least one of a tilt detection signal or an impact detection signal of the device;
determine a function of the video player in response to the detected signal;
Control the video player in response to the determined function of the video player,
The function of the video player includes at least one of a volume control function, a brightness control function, a play/pause function, or a fast forward/rewind function.

Images