KR102449979B1 - Method and device for controlling system based on vehicle virtual structure - Google Patents

Abstract

Embodiments include booting a plurality of containers; confirming the necessity of upgrading the plurality of containers; and performing an upgrade for the plurality of containers in response to the need for the upgrade, wherein the plurality of containers discloses a vehicle virtualization structure-based control method in which the plurality of containers share system initialization and management.

Description

System control method and device based on vehicle virtualization structure

An embodiment of the present invention relates to a system control method and apparatus based on a vehicle virtualization structure.

Vehicles are increasingly moving towards higher levels of computerization. Most vehicle tasks, functions and tasks are currently under computer control or can be monitored by computerized devices. In other words, with the advent of the digital age, consumers can perform similar actions between cell phones and tablet computers in the vehicle. For example, in-vehicle infotainment systems with touch and haptic feedback, natural language voice interaction, proximity sensing and intelligent user interfaces with buttons and controls are now in the spotlight. Thus, in-vehicle information, communication navigation, and entertainment at the same time are streamlined and tailored to driving use.

In accordance with this technological situation, a plurality of display devices exist in a vehicle, and a plurality of software for executing the display devices exist. In addition, the degree of freedom for a user or a passenger in a vehicle to use a plurality of display devices is improved.

However, there are limitations in that it is difficult to update between operating systems in the vehicle, and the use of web platform containers is not independent for each user.

Furthermore, there is a problem in that the risk of driving is increased by mixing sounds between users in the vehicle.

The embodiment may provide a system control method and apparatus based on a vehicle virtualization structure capable of saving disk resources.

In addition, it is possible to provide a system control method and apparatus based on a vehicle virtualization structure having improved driving speed.

In addition, it is possible to provide a system control method and apparatus based on a user-customized vehicle virtualization structure in the vehicle.

In addition, it is possible to provide a system control method and apparatus based on a vehicle virtualization structure that easily use a web application for each user in the vehicle.

In addition, it is possible to provide a system control method and apparatus based on a vehicle virtualization structure in which the in-vehicle sound processing from which the driving obstruction is removed is performed.

The problem to be solved in the embodiment is not limited thereto, and it will be said that the purpose or effect that can be grasped from the solving means or embodiment of the problem described below may also be included.

A vehicle virtualization structure-based control method according to an embodiment includes booting a plurality of containers; confirming the necessity of upgrading the plurality of containers; and performing an upgrade for the plurality of containers in response to the need for the upgrade, wherein the plurality of containers share system initialization and management.

The confirming of the necessity of upgrading the plurality of containers may include: receiving upgrade information; comparing the upgrade information with the upgrades of the plurality of containers; and determining the need for the upgrade.

The method may further include; driving the plurality of containers when there is no need for the upgrade.

The method may further include a step of determining whether the upgrade is an upgrade for a system directory or an upgrade for user data (personal data) when there is a need for the upgrade.

If the system directory is upgraded, performing user authentication after determining whether it is an upgrade; and receiving the system directory.

Rebooting the plurality of containers may further include, and return to the step of confirming the need for the upgrade.

receiving the latest user data after determining whether the user data is an upgrade in the case of an upgrade of the user data; and driving the plurality of containers.

The method may further include, after the step of driving the plurality of containers, the step of executing an application on a display connected to the container.

In the driving of the plurality of containers, the plurality of containers may be driven by copying a change directory among the user data.

The shared system initialization and management may include a kernel, a distro, and a library.

Furthermore, the vehicle virtualization structure-based control method according to an embodiment includes: recognizing a user in driving a container after the above-described update and the like; and confirming whether the recognized user is a pre-registered user.

If the recognized user is not the previously registered user, the step of performing registration; may further include.

setting a vehicle environment when the recognized user is the previously registered user; It may further include; checking whether the web account is registered.

It may further include; registering a web account when there is no registration of the web account.

The method may further include; if there is registration of the web account, determining whether the web account is logged in to another web platform container.

The method may further include outputting termination or re-login when the web account is logged in to another web platform container.

extracting a preferred application when the web account is not logged into another web platform container; ; may be further included.

Displaying a favorite destination by driving the navigation; may further include.

According to the embodiment, a system control method and apparatus based on a vehicle virtualization structure capable of saving disk resources may be implemented.

In addition, it is possible to implement a system control method and apparatus based on a vehicle virtualization structure with improved driving speed.

In addition, it is possible to implement a system control method and apparatus based on a user-customized vehicle virtualization structure in the vehicle.

In addition, it is possible to implement a system control method and apparatus based on a vehicle virtualization structure that easily use a web application for each user in the vehicle.

In addition, it is possible to implement a system control method and apparatus based on a vehicle virtualization structure in which the in-vehicle sound processing from which the driving obstruction is removed is performed.

Various and advantageous advantages and effects of the present invention are not limited to the above, and will be more easily understood in the course of describing specific embodiments of the present invention.

1 is a conceptual diagram of a system based on a vehicle virtualization structure according to an embodiment;
2 is a detailed block diagram of a system based on a vehicle virtualization structure according to an embodiment;
3 is a flowchart of a system control method based on a vehicle virtualization structure according to an embodiment;
4 is a detailed flowchart for confirming the need for upgrade in a system control method based on a vehicle virtualization structure according to an embodiment;
5 is a detailed flowchart of a system control method based on a vehicle virtualization structure according to an embodiment;
6 is a conceptual diagram of a structure of a plurality of containers in a system based on a vehicle virtualization structure according to an embodiment;
7 and 8 are diagrams illustrating driving a plurality of containers in a system based on a vehicle virtualization structure according to an embodiment;
9 is an enlarged view of part K in FIG. 2,
10 is a flowchart of a method for controlling a web platform in a system based on a vehicle virtualization structure according to an embodiment;
11 is a diagram illustrating driving of a web application in a method for controlling a web platform in a system based on a vehicle virtualization structure according to an embodiment;
12 is a conceptual diagram of a system based on a vehicle virtualization structure according to another embodiment;
13 is a view for explaining a display device in a system based on a vehicle virtualization structure according to an embodiment;
14 is a block diagram of a sound control device based on a vehicle virtualization structure according to an embodiment;
15 is a flowchart of a sound control method based on a vehicle virtualization structure according to an embodiment;
16 is a detailed flowchart of a sound control method based on a vehicle virtualization structure according to an embodiment;
17 is a view for explaining the output of the first sound output information and the second sound output information for an example,
18 is a view for explaining the output of the first sound output information and the second sound output information for another example,
19 is a view for explaining the output of the first sound output information and the second sound output information for another example,
20 is a conceptual diagram of a system based on a vehicle virtualization structure according to a modified example.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated and described in the drawings. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

Terms including an ordinal number such as second, first, etc. may be used to describe various elements, but the elements are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the second component may be referred to as the first component, and similarly, the first component may also be referred to as the second component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, the embodiment will be described in detail with reference to the accompanying drawings, but the same or corresponding components are given the same reference numerals regardless of the reference numerals, and the overlapping description thereof will be omitted.

An embodiment of the present disclosure relates to a vehicle streaming control apparatus and control method for a vehicle, vehicle infotainment, etc. In using an application ('app', 'application', application in the same sense) in a vehicle, the vehicle infotainment and The content is to provide an integrated system environment. However, these contents do not limit the rights of this patent.

More specifically, in the case of a vehicle system, an important function related to vehicle control is performed while providing a vehicle infotainment function. Here, the functions related to vehicle control include applications including navigation systems that affect the user's vehicle operation, cluster systems that indicate vehicle speed or RPM, etc. It also includes important functions related to the life of the occupants, such as control systems. In addition, the display of these applications should be done freely, but should not interfere with driving such as vehicle control. In other words, the protection of vehicle driving must be kept essential. If this protection is not provided, accidents may occur. Accordingly, in a preferred embodiment of the present invention, streaming in the vehicle is performed within a range that does not interfere with driving, so that services and applications related to entertainment, such as audio reproduction, video reproduction, and game execution, access to the vehicle's occupants, including the driver. and operation can be made easily.

1 is a conceptual diagram of a system based on a vehicle virtualization structure according to an embodiment, and FIG. 2 is a detailed block diagram of a system based on a vehicle virtualization structure according to an embodiment.

1 and 2 , a system based on a vehicle virtualization structure according to an embodiment includes hardware (not shown), a base operating system 10 mounted on hardware (not shown), and a base operating system 10 . It is mounted on the first virtual engine 20a and the second virtual engine 20b mounted thereon, at least one operating system 30a to 30f mounted on each virtual engine, and at least one operating system 30a to 30f. A software set including middleware and important applications, a plurality of operating system platforms 40a to 40f, a plurality of applications 50a to 50d running on the operating system platforms 40a to 40f, a plurality of operating system platforms 40a to 40f, or a plurality of It may include a container manager (CM) that manages environments for the plurality of operating systems 30a to 30d on the plurality of displays 60a to 60f and virtual engines 20a to 20b for outputting applications of . At least one operating system will be described below as a 'container'.

Here, hardware (not shown) may be a concept including a processor, a display unit, a storage unit, a memory unit, a control unit, and an I/O device.

In the embodiment, the driving unit CP is a system area mounted or driven on the first virtual engine 20a, and the infotainment unit (IP, Infotainment Platform) is a second virtual engine different from the first virtual engine 20a. It may be a system area mounted or driven on the virtual engine 20b. Due to this configuration, even if an upgrade or other malfunction occurs in the infotainment unit IP, the driving unit CP may not be affected. That is, the influence while driving can be minimized. Furthermore, in addition to the infotainment unit (IP), a web platform unit (Web Platform) may be mounted or driven on the base operating system 10 and the additional virtual engine 20 . Like the infotainment unit (IP), the platform unit (Web Platform) may share the container manager with the infotainment unit (IP). Alternatively, the platform unit (Web Platform) may be configured as a part of the infotainment unit (IP). Hereinafter, individual configurations will be described.

The platform unit (Web Platform) is a set of software installed on one operating system (eg, container, 30), the operating system mounted on the container management unit, such as the infotainment unit (IP), and including middleware and important applications, and a plurality of operating system platforms ( For example, the AGL 40 may include a plurality of applications (eg, web applications 50 ) running on the operating system platform 40 .

First, the base operating system 10 may be, for example, various operating systems. For example, the base operating system 10 may include Linux, a hypervisor, QNX, GENIVI, and the like.

For example, the first virtual engine 20a and the second virtual engine 20b are middleware solutions or various platforms, and may be developed in 　mobile and C language. The first virtual engine 20a and the second virtual engine 20b may provide a plurality of built-in libraries, and may perform the same operation in various mobile terminals. For example, the first virtual engine 20a and the second virtual engine 20b may be a Linux-based Android kernel, and may initialize memory protection, a virtual memory module, and schedule caching.

Also, the at least one container 30a to 30d may be mounted on the second virtual engine 20a and not mounted on the first virtual engine 10a. Accordingly, since security for the driving unit CP is improved, driving stability may also be improved.

At least one container 30a to 30d may be a schedule of process virtualization as a form of a virtualization method in an embodiment. For example, virtualization technology using containers divides the inside of the host OS (operating system) into a kernel space that manages physical resources and a user space that executes a user process, that is, an application program (application, application, APP), and divides the user space into a user space. It may refer to a technology for allocating and sharing hardware resources used in each user process by dividing it into several pieces. For example, the containers 30a to 30d may convert the called library to be interfaced with the system library, thereby performing connection or compatibility between the base operating system and a plurality of operating system platforms.

The plurality of operating system platforms 40a to 40f may be mounted on a container. The plurality of operating system platforms 40a to 40f may include Android, Automotive Grade Linux (AGL), a web platform, a cluster platform, a head-up display (HUD) platform, and the like.

The at least one application 50a to 50d is an application program other than a system program, and may include Audio Video Navigation (AVN), Co-Driver, Rear Seat Entertainment (RSE), and the like in the vehicle.

The plurality of displays 60a to 60f may display the operating system platform 40a to 40f or an application program on the platform to a user (eg, a passenger). For example, the plurality of displays 60a to 60f may include various display devices (eg, OLEDs).

The container manager CM may manage environments for the plurality of operating systems 30a to 30d on the virtual engines 20a to 20b. That is, the container management unit CM may perform resource allocation for containers, streaming connection, update, display output, connection with the output unit, and the like, for example, of the plurality of operating systems 30a to 30d . A detailed description thereof will be given later.

Specifically, the container management unit CM may include a container control unit CM1 , a container upgrade unit CM2 , a container state management unit CM3 , a web platform container management unit CM4 , and a container bridge unit CM5 .

The container control unit CM1 may perform system resources allocated to containers, resource policies, streaming control related, output related to display, file system management, and the like.

The container control unit CM1 includes a container resource management unit M1-1, a display control unit M1-2, a container policy management unit M1-3, a container file system management unit M1-4, and a container streaming management unit M1-5. ) and an audio policy and control management unit M1-6.

The container resource management unit M1-1 may dynamically allocate system resources allocated to containers. For example, the container resource management unit M1-1 may collect resource usage to prevent QoS performance degradation due to resource shortage. For example, the container resource management unit M1-1 may set a container to be allocated to a dedicated core by using a preset container priority, a resource usage threshold, and a monitoring and monitoring period.

The container policy management unit M1-3 may include information on priorities allocated to dedicated cores among the aforementioned containers.

The display control unit M1 - 2 may manage the containers responsible for the operation of each of the plurality of displays to output a screen to each display in the vehicle.

The container file system manager M1-4 may systematically and efficiently manage files necessary for the operation of each container in a plurality of container environments. For example, the container file system manager M1-4 may overlay a file system of a container with another container file system, for example, as any one file system, as will be described later. Accordingly, a user (a plurality of passengers) can easily share a file system such as a container with other users or other locations (eg, seats).

That is, in the system based on the vehicle virtualization structure according to the embodiment, a plurality of containers may share system initialization and management. For example, in the system based on the vehicle virtualization structure according to the embodiment, a plurality of containers may share rootfs. In addition, each operating system, that is, the container stores or copies (copy) a separate change directory, so that resources such as disks can be efficiently used. Furthermore, the upgrade for each container may also be performed using only the change directory. For example, each display device can be effectively upgraded.

The container streaming management unit M1-5 may manage the movement of images output from each display, and the like. That is, the container streaming management unit M105 may determine whether streaming is possible according to each policy of the driving unit, the infotainment unit, and the display.

The audio policy and control manager M1-6 may control audio output by reflecting a policy on audio output between at least one container. A detailed description thereof will be given later.

The container upgrade unit CM2 may perform an upgrade for each operating system of the infotainment unit including a plurality of operating systems. For example, the container upgrade unit CM2 may easily upgrade each container of the infotainment unit composed of containers.

The container upgrade unit CM2 may include an update and confirmation management unit M2-1 and an authentication management unit M2-2.

The update and check management unit M2-1 may check an identifier for each container for a container requiring an update among a plurality of containers and a normal operation check after the update.

The authentication management unit M2-2 may perform authentication and version comparison for each vehicle and container in order to perform the update.

The container state management unit CM3 may manage the states of a plurality of containers, such as checking whether the container operates normally.

The container state management unit CM3 may include a state management unit M3-1 and a log management unit M3-2.

The state management unit M3 - 1 may check whether the container and functions of the container management unit operate normally through periodic monitoring.

The log management unit M3-2 may keep a log of the contents checked through the container state management unit. Furthermore, the log management unit M3-2 may delete or backup the log after a predetermined time. Furthermore, when the container operates abnormally, the state management unit M3-1 can easily solve the problem through the log management unit M3-2.

The web platform container management unit CM4 may manage the web platform container, and may include a web platform management unit M4-1 and a web account management unit M4-2.

The web platform management unit M4-1 may manage whether various functions of the web platform operate normally on the operating system, that is, the container. In addition, when a plurality of web platform containers are operated, the web platform management unit M4-1 may manage a login account for each container to manage a personalized web use environment. A detailed description thereof will be given later.

Furthermore, the container bridge unit CM5 may be connected to an interface, hardware, etc. to perform interconnection between respective operating systems for display, audio, application, network, and the like.

And each element described in the drawings is an example, and will be described below based on this.

In addition, a user (eg, an occupant) may operate a vehicle virtualization structure-based system through a user interface or the like. In addition, the manipulation process or result may be provided to the user through an output device such as a display or audio. In addition, the feedback may be provided through an input such as a user manipulating a touch on the display.

3 is a flowchart for a system control method based on a vehicle virtualization structure according to an embodiment, FIG. 4 is a detailed flowchart for confirming the necessity of an upgrade in a system control method based on a vehicle virtualization structure according to an embodiment, and FIG. 5 is an implementation It is a detailed flowchart of a system control method based on a vehicle virtualization structure according to an embodiment, FIG. 6 is a conceptual diagram of a structure of a plurality of containers in a system based on a vehicle virtualization structure according to an embodiment, and FIGS. 7 and 8 are in the embodiment It is a diagram for explaining driving a plurality of containers in a system based on a vehicle virtualization structure according to the present invention.

The system control method based on the vehicle virtualization structure according to the embodiment includes the steps of booting a plurality of containers (S310), confirming the necessity of upgrading the plurality of containers (S320), and providing a plurality of containers in response to the need for upgrade. It may include the step of performing the upgrade (S330).

In this case, in the system based on the vehicle virtualization structure according to the embodiment, a plurality of containers may share system initialization and management as described above.

For example, a plurality of containers (Container1 to Container 3) may share a shared system initialization and management rootfs. That is, the plurality of containers Container1 to Container 3 may share a kernel, a distro, and a library with each other.

In this case, the system control method based on the vehicle virtualization structure may be performed by the above-described container management unit (CM). That is, the system control device based on the vehicle virtualization structure may include a container management unit (CM). Furthermore, the system control apparatus based on the vehicle virtualization structure may include a container control unit CM1 and a container upgrade unit CM2, and may perform each control step to be described later. Hereinafter, the apparatus in which each step is performed will be briefly described.

In an embodiment, the container controller may boot a plurality of containers ( S310 ). In addition, the container upgrade unit CM2 may determine the need to upgrade the operating system, that is, the plurality of booted containers ( S320 ).

Specifically, confirming the necessity of upgrading the plurality of containers includes receiving upgrade information (S321), comparing the upgrade information with the upgrades of the plurality of containers (S322), and determining the need for upgrade (S323) ) may be included.

The container upgrade unit CM2 may receive update information from a server or the like. The update information may include version information of the corresponding container.

In addition, the container management unit CM or the container upgrade unit CM2 may compare the received upgrade with upgrade information of a plurality of containers, that is, upgrade information. Accordingly, by comparing the received upgrade information with the upgrade information of the corresponding container, it may be determined whether the upgrade information of the container is newer than the received upgrade information.

For example, the container management unit CM or the container upgrade unit CM2 may determine that there is no need for an upgrade when the received upgrade information and the container upgrade information are the same version or the container upgrade information is the latest. Also, when the received upgrade information is a version lower than the container upgrade information, it may be determined that the upgrade is necessary. That is, it may be determined whether there is a need to upgrade a plurality of containers ( S334 ).

In addition, the container management unit CM may perform an upgrade for a plurality of containers in response to the need for upgrade ( S330 ). Only when there is a need for upgrade, the container management unit CM may perform the upgrade for a plurality of containers. And when there is no need for upgrading, the container controller CM1 may drive a plurality of containers ( S340 ). That is, the container can be driven by loading personal data for each display. At this time, as described above, the container management unit (CM) or the container control unit (CM1) shares the system initialization and manager rootfs in each display-specific container in the vehicle, and each container (eg, display-specific) shares user data. By overlaying rootfs, you can save disk resources. Accordingly, efficient container operation or driving can be achieved. Furthermore, the container may be driven by copying user data. In an embodiment, a plurality of containers may be driven or executed by copying a change directory among user data. That is, the latest version of the user data delta0/ may be copied as the new user data delta1/. Accordingly, a new container (snap clone) can be easily driven after the existing container (original) is driven. For example, a container for a plurality of RSE displays may be more easily driven. In addition, the existing latest version of user data or driven user data (new files) may be overlaid on the shared rootfs (root files) as described above (mount). In this way, both driving and updating of the container (system files and user data) can be easily performed.

In addition, the container management unit CM or the container control unit CM1 may execute an application through a display connected to the container (S350). Accordingly, each service (eg, application execution) for each display located in each occupant in the vehicle may be provided to the occupant.

In addition, the container management unit CM or the container control unit CM1 may determine whether the upgrade is for the system directory or the user data (personal data) when there is a need for the upgrade ( S360 ). This may be a step in which the step ( S330 ) of performing the upgrade for a plurality of containers in response to the above-described need for upgrading is specified. That is, the upgrade of the container may be embodied as follows.

In the case of an upgrade for the system directory, the container management unit CM may perform user authentication after determining whether it is an upgrade (S360) (S370) and receive the system directory (S380).

The container management unit CM or the container upgrade unit CM2 may perform user authentication. User authentication may include authentication for vehicles and containers. That is, after determining the type of vehicle and the type of container, authentication of the container corresponding to the vehicle may be performed ( S370 ).

In addition, the container management unit CM or the container upgrade unit CM2 may receive the latest version of the file system from the server. For example, a kernel, OS, and library exist as a file system. The received file system can be applied to the shared rootfs. That is, the vehicle virtualization structure-based control method and apparatus according to the embodiment can easily perform system directory upgrade for the same container type on the same virtual engine by the container manager (or including the container manager). That is, the system directory upgrade for a plurality of containers may be performed by receiving the system directory once. Thereafter, the plurality of containers may be rebooted ( S390 ).

After that, it is possible to return to the step (S320) of confirming the need for the upgrade to perform the above-described steps or functions.

In the case of an upgrade for user data (personal data), a plurality of containers may be driven after determining whether the upgrade is an upgrade ( S360 ) ( S340 ). However, it is possible to receive the latest user data before (S365). Here, the latest means a case in which the preservation is higher or the date of modification is the closest.

The latest user data can be applied to each container. At this time, as described above, by overlaying user data on the shared rootfs, user data can be loaded and individual containers can be driven. Accordingly, it is possible to minimize the use of disk resources.

Furthermore, the container management unit CM may execute an application through a display connected to the container ( S350 ). That is, the application may be driven on each container and output through each display. Accordingly, each service (eg, application execution) for each display located in each occupant in the vehicle may be provided to the occupant.

9 is an enlarged view of part K in FIG. 2 , FIG. 10 is a flowchart for a web platform control method in a vehicle virtualization structure-based system according to an embodiment, and FIG. 11 is a vehicle virtualization structure-based system according to an embodiment It is a diagram showing the driving of a web application in a web platform control method.

9 to 11 , as described above, the vehicle virtualization structure-based system according to the embodiment includes a web platform mounted or driven on the base operating system 10 and the additional virtual engine 20 . may include Like the infotainment unit (IP), the platform unit (Web Platform) may share the container manager with the infotainment unit (IP). Alternatively, the platform unit (Web Platform) may be configured as a part of the infotainment unit (IP). As mentioned above, this will be described as an individual configuration.

In addition, the platform unit (Web Platform) includes one operating system (eg, container, 30) mounted on the container management unit like the infotainment unit (IP), a software set mounted on the operating system and including middleware and important applications, and a plurality of operating systems. It may include a platform (eg, AGL, 40 ) and a plurality of applications (eg, web application, 50 ) running on the operating system platform 40 .

Furthermore, the virtual engine 20 may include a vehicle information service server (VIS server). The vehicle information service server (Vehicle Information Service Sever, VIS server) stores vehicle driving unit information (speed, fuel amount, etc.) and vehicle setting information (temperature, seat position, etc.) and transmits it to each web platform container, that is, the operating system platform 40. have. That is, the vehicle information service server (Vehicle Information Service Sever, VIS server) is requested by the vehicle information service client (Vehicle Information Service Sever, VIS Client) in each web operating system platform 40 or vehicle driving unit information corresponding to the occupant and vehicle You can provide configuration information.

In addition, the container manager CM may include the web platform container manager CM4 as described above. In addition, the web platform container management unit CM4 may manage the web platform container, and may include a web platform management unit and a web account management unit.

The web platform management unit may manage whether various functions of the web platform operate normally on the operating system, that is, the container. In addition, when a plurality of web platform containers are operated, the web platform management unit may manage a login account for each container to manage a personalized web use environment.

The operating system platform 40 is an AGL, and may include a vehicle information service server (VIS Client) that receives requested or corresponding vehicle driver information and vehicle setting information to set a vehicle environment.

Furthermore, the operating system platform 40 drives a plurality of web platform containers (operating system, 30) to expand the API service unit for user recognition and registration (Device API service), and a function to manage web applications included in the operating system platform. Includes an add-on unit (WAM add on) that monitors and manages whether a plurality of web applications can use hardware resources such as GPS, and a virtual keyboard unit (Virtual Keyboard) for text input when using web applications can do.

More specifically, the vehicle virtualization structure-based control method according to the embodiment may include recognizing a user in relation to web platform control (S405) and checking whether the recognized user is a previously registered user (S410). have.

That is, the operating system platform 40 or the API service unit (Device API service) may recognize the user (S405). In other words, individual recognition of each occupant in the vehicle can be achieved. User recognition may be performed through various devices (sensor, mobile, application, etc.). In addition, the step of recognizing the user ( S405 ) may be performed after the aforementioned update and container operation. For example, the step of recognizing the user ( S405 ) may be performed after the application is driven on each container and output to each display ( S350 ). In this case, the user of the vehicle occupant may drive the web platform container and user recognition may be performed.

The operating system platform 40 or the API service unit (Device API service) may check whether the recognized user is a pre-registered user (S410). If the operating system platform 40 or the API service unit (Device API service) is not a previously registered user, the user may be registered (S415), and in the case of the previously registered user, the vehicle environment may be set (S420) . The environment may include seat position, preferred temperature, lighting conditions, and the like.

In particular, user recognition may be made in conjunction with the container management unit (CM) or the web platform container management unit (CM4). The web platform container management unit (CM4) manages web account registration, change, deletion, etc., can confirm that the web account is a registered account, executes and manages the application list for each web account, or does not cause duplicate web account logins. You can manage the login status to prevent it from happening. That is, user information provided from the operating system platform 40 or the API service unit (Device API service) is checked in the container management unit (CM), and an application list execution and management for each account or duplicate login management can be performed.

In addition, the container management unit (CM) authentication web platform container management unit (CM4) may check whether a web account is registered for the recognized user, that is, user information (S425).

Accordingly, the container management unit (CM) authentication web platform container management unit (CM4) registers and stores a web account (S430) if the web account for the user is not registered or does not exist, and when the web account is registered, the web account is It can be checked whether the user is logged in to another web platform container (S435).

Accordingly, the container management unit (CM) authentication web platform container management unit (CM4) outputs termination or re-login when the web account is logged in to another web platform container (S440), but if the web account is not logged in, each web account The application may be extracted (S445). In addition, the extracted preferred application for each web account may be provided to the user (refer to FIG. 11 ). Accordingly, the user can easily recognize the preferred or real-time web application operation for each web account.

And the container management unit (CM) increase web platform container management unit (CM4) may drive the navigation application and display the destination on the display (S450). In addition, the user may input a destination through a virtual keyboard (S455). As described above, from the vehicle virtualization structure-based control method and device according to the embodiment to the web platform control (method or device), the web platform application is easily used according to user recognition, and the same application is applied to each operating system (web platform container). can run with different user or passenger web accounts. Accordingly, the same application can be driven and executed using individual accounts between passengers in the vehicle.

12 is a conceptual diagram of a system based on a vehicle virtualization structure according to another embodiment, and FIG. 13 is a view for explaining a display device in a system based on a vehicle virtualization structure according to an embodiment.

12 and 13, as described above, the vehicle virtualization structure-based system according to the embodiment includes hardware (not shown), the base operating system 10 mounted on the hardware (not shown), and the base operating system. A first virtual engine 20a and a second virtual engine 20b mounted on the system 10, at least one operating system 30a to 30f, and at least one operating system 30a to 30f mounted on each virtual engine A software set mounted on the platform and including middleware and important applications, a plurality of operating system platforms 40a to 40f, a plurality of applications 50a to 50d running on the operating system platforms 40a to 40f, and a plurality of operating system platforms 40a to 40f 40f) or a container management unit (CM) that manages environments for a plurality of operating systems 30a to 30d on a plurality of displays 60a to 60f and virtual engines 20a to 20b for outputting a plurality of applications, etc. Can be included. have. At least one operating system will be described below as a 'container'.

Here, hardware (not shown) may be a concept including a processor, a display unit, a storage unit, a memory unit, a control unit, and an I/O device.

In the embodiment, the driving unit CP is a system area mounted or driven on the first virtual engine 20a, and the infotainment unit (IP, Infotainment Platform) is a second virtual engine different from the first virtual engine 20a. It may be a system area mounted or driven on the virtual engine 20b. Due to this configuration, even if an upgrade or other malfunction occurs in the infotainment unit IP, the driving unit CP may not be affected. That is, the influence while driving can be minimized. Furthermore, in addition to the infotainment unit (IP), a web platform unit (Web Platform) may be mounted or driven on the base operating system 10 and the additional virtual engine 20 . Like the infotainment unit (IP), the platform unit (Web Platform) may share the container manager with the infotainment unit (IP). Alternatively, the platform unit (Web Platform) may be configured as a part of the infotainment unit (IP). Hereinafter, individual configurations will be described.

The platform unit (Web Platform) is a set of software installed on one operating system (eg, container, 30), the operating system mounted on the container management unit, such as the infotainment unit (IP), and including middleware and important applications, and a plurality of operating system platforms ( For example, the AGL 40 may include a plurality of applications (eg, web applications 50 ) running on the operating system platform 40 .

First, the base operating system 10 may be, for example, various operating systems. For example, the base operating system 10 may include Linux, a hypervisor, QNX, GENIVI, and the like.

For example, the first virtual engine 20a and the second virtual engine 20b are middleware solutions or various platforms, and may be developed in 　mobile and C language. The first virtual engine 20a and the second virtual engine 20b may provide a plurality of built-in libraries, and may perform the same operation in various mobile terminals. For example, the first virtual engine 20a and the second virtual engine 20b may be a Linux-based Android kernel, and may initialize memory protection, a virtual memory module, and schedule caching.

Also, the at least one container 30a to 30d may be mounted on the second virtual engine 20a and not mounted on the first virtual engine 10a. Accordingly, since security for the driving unit CP is improved, driving stability may also be improved.

At least one container 30a to 30d may be a schedule of process virtualization as a form of a virtualization method in an embodiment. For example, virtualization technology using containers divides the inside of the host OS (operating system) into a kernel space that manages physical resources and a user space that executes a user process, that is, an application program (application, application, APP), and divides the user space into a user space. It may refer to a technology for allocating and sharing hardware resources used in each user process by dividing it into several pieces. For example, the containers 30a to 30d may convert the called library to be interfaced with the system library, thereby performing connection or compatibility between the base operating system and a plurality of operating system platforms.

The plurality of operating system platforms 40a to 40f may be mounted on a container. The plurality of operating system platforms 40a to 40f may include Android, Automotive Grade Linux (AGL), a web platform, a cluster platform, a head-up display (HUD) platform, and the like. Furthermore, a plurality of sound clients may be disposed in the operating system platform 40 . The plurality of sound clients may include a first sound client and a second sound client. In this case, the first sound client may be mounted on the operating system platforms 40a and 40b on the first virtual engine 20a. The second sound client may be mounted on the operating system platform 40c or the like on the second virtual engine 20b. That is, the first sound client and the second sound client may be mounted on different virtual engines. And the first sound client may be mounted on the cluster operating system (40a) or the HUD operating system (40b). In addition, the second sound client may be mounted on an Audio Video Navigation (AVN) operating system, a Co-Driver operating system, and a Rear Seat Entertainment (RSE) operating system.

Furthermore, the sound server may receive the first sound output information and the second sound output information from the first sound client SC1 and the second sound client SC2, respectively. The sound server may be mounted in the virtual engines 20a and 20b or in the base operating system 10 . Hereinafter, the sound server includes a first sound server (SS1) and a second sound server (SS2), and the first sound server (SS1) and the second sound server (SS2) are mounted on a heterogeneous virtual engine. Explain.

The at least one application 50a to 50d is an application program other than a system program, and may include Audio Video Navigation (AVN), Co-Driver, Rear Seat Entertainment (RSE), and the like in the vehicle.

The plurality of displays 60a to 60f may display the operating system platform 40a to 40f or an application program on the platform to a user (eg, a passenger). For example, the plurality of displays 60a to 60f may include various display devices (eg, OLEDs).

The following description may refer to the above-described audio policy and control management unit.

In addition, a user (eg, an occupant) may operate a vehicle virtualization structure-based system through a user interface or the like. In addition, the manipulation process or result may be provided to the user through an output device such as a display or audio.

14 is a block diagram of a sound control apparatus based on a vehicle virtualization structure according to an embodiment, FIG. 15 is a flowchart of a sound control method based on a vehicle virtualization structure according to an embodiment, and FIG. 16 is a vehicle virtualization structure based according to an embodiment is a detailed flowchart of a sound control method of , FIG. 17 is a diagram for explaining the output of the first sound output information and the second sound output information for one example, and FIG. 18 is the first sound output information and the second sound output information for another example It is a view for explaining the output of sound output information, and FIG. 19 is a view for explaining the output of the first sound output information and the second sound output information for another example.

Referring to FIG. 14 , the sound control apparatus 100 based on the vehicle virtualization structure according to the embodiment may include a receiving unit 110 , a comparing unit 120 , a determining unit 130 , and a transmitting unit 140 . In this case, the vehicle virtualization structure-based sound control device 100 includes an audio policy and control management unit, and the audio policy and control management unit includes a receiver 110 , a comparison unit 120 , a determination unit 130 , and a transmission unit 140 . ) can be matched.

First, the receiver 110 may receive sound output information from each sound client. For example, the receiver 110 may receive at least one of the first sound output information from the first sound client and the second sound output information from the second sound client. In addition, the sound output information may be generated by a user's input or the like. That is, the sound output information may include sound information output while an application is executed by a user input.

The comparison unit 120 may compare the priority of the received first sound output information and the second sound output information. The priority of the first sound output information may be higher than the priority of the second sound output information. Accordingly, since the sound output information received from the driving unit has a higher priority than the sound output information received from the infotainment unit, driving stability can be improved.

The determination unit 130 may determine whether the first sound output information is generated when the vehicle is driving. In this case, the determination unit 130 may determine to output the second sound output information after outputting the first sound output information.

And if the generation time of the first sound output information is the driving of the vehicle, the determination unit 130 adjusts whether the first sound output information and the second sound output information are output and outputs the output time according to the level of the first sound output information. can be judged to be

Specifically, when the level of the first sound output information is the first level, the determination unit 130 may determine to output only the first sound output information and block the output of the second sound output information. In this case, the level of the output information may include a first level and a second level lower than the first level.

In addition, when the level of the first sound output information is the second level, the determination unit 130 may output the first sound output information and the second sound output information for a first time. Also, the determination unit 130 may determine to output the second sound output information for a second time continuous to the first time. In this case, the size of the first sound output information for the first time may be greater than the size of the second sound output information. With this configuration, stability improvement during vehicle driving can be achieved.

In addition, a sound client in a virtual engine (virtualization environment) or an operating system (eg, a guest operating system, etc.) mounted (or embedded) in the host operating system may receive or request sound output information from a display device connected to each operating system or the like. Receiving and requesting sound output information may mean sound data for which output is requested.

In addition, the sound server mounted in the virtual engine or container or the base operating system may receive data, that is, sound output information, and transmit the sound output information to hardware to output sound through a speaker, which is an output interface, or the like. In this case, sound output information, that is, data may be delivered to a display device through a sound client in a virtual engine or a sound client installed (or embedded) in a host operating system (eg, a guest operating system) to be provided to the user.

Also, the transmitter 140 may transmit at least one of the finally determined first sound output information and the second sound output information to hardware or the like. Through this, sound may be output through a front or rear sound output device (eg, a speaker) of the vehicle.

15 to 19 , the method for controlling a sound based on a vehicle virtualization structure according to an embodiment includes receiving at least one of first sound output information from a first sound client and second sound output information from a second sound client (S510), comparing the priority of the received first sound output information and the second sound output information (S520), and at least one of the first sound output information and the second sound output information in response to the comparison result may include a step (S530) of transmitting to hardware. Hereinafter, each step may be performed by the above-described vehicle virtualization structure-based sound control device.

In addition, the first sound client and the second sound client are mounted on different virtual engines, the first sound client is mounted on a cluster operating system, and the second sound client is an AVN (Audio Video Navigation) operating system, a co-driver ( It can be installed in the Co-Driver operating system and RSE (Rear Seat Entertainment) operating system.

In addition, the priority of the first sound output information may be higher than the priority of the second sound output information.

After the priority is compared (S520), it may be checked whether the first sound output information is generated when the vehicle is driving (S540).

In an embodiment, if the generation time of the first sound output information is not while the vehicle is being driven, the second sound output information may be output after the first sound output information is output ( S550 ). For example, it may be necessary to reproduce a notification sound of the driving unit before the infotainment unit reproduces audio before driving starts. In this case, as shown in FIG. 17 , a notification (first sound output information) of the driving unit may be output first until a specific time ta, and audio (second sound output information) of the infotainment unit may be output after a specific time ta. . That is, after turning on the engine, notification sounds such as fuel shortage notification and consumable replacement notification may be preferentially output (played) before media playback such as AVN radio. In other words, at least one of the first sound output information and the second sound output information (transmitting the second sound output information after the first sound output information is transmitted while the vehicle is driving) may be transmitted in response to the comparison result.

In addition, if the generation time of the first sound output information is while the vehicle is driving, the output of the first sound output information and the second sound output information and output time may be adjusted and outputted according to the level of the first sound output information ( S570). Here, the level of the output information may include a first level and a second level lower than the first level.

In addition, it may be determined whether the level of the first sound output information is the first level. If the level of the first sound output information is the first level, only the first sound output information may be output and the output of the second sound output information may be blocked ( S580 ).

For example, the audio (or sound) of the driving unit may be output while the vehicle is driving and the audio of the infotainment unit may be muted. Through this, the driver is fully aware of the dangerous state, so that the occurrence of an accident can be suppressed. That is, as shown in FIG. 18 , only the first sound output information may be output and the output of the second sound output information may be blocked.

For example, since the vehicle driving unit failure, drowsiness prevention warning sound, etc. (first sound output information) must be output in a state in which the infotainment unit audio (second sound output information) is blocked while driving, only the first sound output information is transmitted to the hardware. can

And when the level of the first sound output information is the second level, the first sound output information and the second sound output information are output for a first time (S590), and the second sound output information is continuously output for the first time. It can output for 2 hours (S595).

Referring to FIG. 19 , the first sound output information and the second sound output information may be output until the first time t1. In this case, during the first time t1 , the size AM1 of the first sound output information may be greater than the size AM2 of the second sound output information. Accordingly, the driver can easily recognize the audio of the first sound output information.

Accordingly, the first sound output information requesting instantaneous attention, such as a lane departure warning sound and a consumable replacement notification while driving, may be easily provided to the driver.

Furthermore, if only the second sound output information is received, the second sound output information may be transmitted to the hardware in the transmitting step.

In contrast, when display devices output audio data, a priority may exist between these devices. For example, AVN, RSE, Co-drive, and the order of priority may be set.

For example, when only the AVN outputs audio, all sound devices (hereinafter, speakers) of the vehicle may output the corresponding audio. When AVN and RSE simultaneously output audio, when audio is output on the front of the vehicle, the audio output of AVN is output from the speaker on the front of the vehicle, and audio output of RSE is output from the speaker on the rear of the vehicle can be In addition, when the AVN and the co-drive simultaneously output audio, the most recently output audio output among the AVN and the co-drive may be output to all speakers of the vehicle.

20 is a conceptual diagram of a system based on a vehicle virtualization structure according to a modified example.

As described above, the vehicle virtualization structure-based system according to the embodiment includes at least hardware (not shown), the base operating system 10 mounted on the hardware (not shown), and at least the base operating system 10 mounted on the base operating system 10 . One operating system 30a to 30f, a software set mounted on at least one operating system 30a to 30f and including middleware and important applications, in a plurality of operating system platforms 40a to 40f and operating system platforms 40a to 40f The plurality of applications 50a to 50d, the plurality of operating system platforms 40a to 40f, or the plurality of displays 60a to 60f and virtual engines 20a to 20b for outputting a plurality of applications, etc., the plurality of operating systems 30a to 30d) may include a container management unit (CM) for managing the environment. At least one operating system will be described below as a 'container'. That is, the above-described sound control may be performed with the system based on the vehicle virtualization structure shown in FIG. 20 without the above-described virtual engine.

The above-described embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include computer storage media. Computer storage media may include both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data.

In addition, the vehicle software control device described in this embodiment may be implemented as a computer program stored in a computer-implementable storage medium. In addition, the term '~ unit' used in this embodiment means software or a hardware component such as a field-programmable gate array (FPGA) or ASIC, and '~ unit' may perform certain roles. However, '-part' is not limited to software or hardware. '~' may be configured to reside in an addressable storage medium or may be configured to refresh one or more processors. Thus, as an example, '~' refers to components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

In the above, the embodiment has been mainly described, but this is only an example and does not limit the present invention, and those of ordinary skill in the art to which the present invention pertains are not exemplified above in the range that does not depart from the essential characteristics of the present embodiment. It will be appreciated that various modifications and applications are possible. For example, each component specifically shown in the embodiment can be implemented by modification. And the differences related to these modifications and applications should be construed as being included in the scope of the present invention defined in the appended claims.

Claims (10)

booting, by the container controller, a plurality of containers;
determining, by a container upgrading unit, the necessity of upgrading the plurality of containers; and
performing, by a container manager, an upgrade on the plurality of containers in response to the need for the upgrade;
The plurality of containers share system initialization and management,
The step of confirming the necessity of upgrading the plurality of containers includes:
receiving, by the container upgrade unit, upgrade information;
comparing, by the container upgrading unit, the upgrade information with the upgrades of the plurality of containers;
determining, by the container upgrade unit, the need for the upgrade; and
Further comprising; if the need for the upgrade exists, determining whether it is an upgrade for a system directory or an upgrade for user data (personal data);
A vehicle virtualization structure-based control method in which the plurality of containers are upgraded to a system directory by receiving a system directory once.
delete According to claim 1,
Driving the plurality of containers when the container upgrade unit does not require the upgrade; the vehicle virtualization structure-based control method further comprising a.
delete According to claim 1,
In the case of an upgrade to the system directory, after determining whether it is an upgrade,
performing user authentication by the container management unit; and
The container management unit receiving the system directory; Vehicle virtualization structure-based control method further comprising a.
6. The method of claim 5,
Rebooting, by the container manager, the plurality of containers; further comprising,
A vehicle virtualization structure-based control method returning to the step of confirming the need for the upgrade.
According to claim 1,
After the step of determining whether the upgrade is an upgrade for the user data,
receiving, by the container management unit, the latest user data; and
Driving the plurality of containers by the container management unit; Vehicle virtualization structure-based control method further comprising a.
8. The method of claim 3 or 7,
After the step of driving the plurality of containers,
The control method based on the vehicle virtualization structure further comprising; executing, by the container manager, an application on a display connected to the container.
8. The method of claim 7,
In the step of driving the plurality of containers,
A vehicle virtualization structure-based control method for driving the plurality of containers by copying a change directory among the user data.
8. The method of claim 7,
The shared system initialization and management is a vehicle virtualization structure-based control method including a kernel, a distro, and a library.

Images