Workload control

All workloads that have been deployed to the node are displayed in tiles. In the Management System, they are located below the node details in the node tree. In the Local UI, they can be found in the Workload management menu. Selecting a tile allows control of the respective workload. There are unique additional control options for each workload type. Note that CODESYS workloads can only be controlled from the Local UI.

Item	Description
Back button (1)	Click here to return to the node tree.
Device and workload name (2)	The names of the device, the workload and the release name are displayed here as <devicename> / <workloadname> / <releasename>. The name of the workload version is not displayed.
Workload status (3)	The current status of the workload is displayed here. The possible statuses are the following: Idle This is the initial state of the workload before it is started. Creating This is a transitional state of the workload when it is being created on the node. Starting This is a transitional state when the workload is being started. Restarting This is a transitional state when the workload is being restarted. Started The workload is running and operating. Suspending This is a transitional state when the workload is being suspended. Suspended The workload has been paused. Resuming This is a transitional state when the workload is being resumed from the suspended state. Stopping This is a transitional state when the workload is being stopped. Stopped The workload has been stopped. Removing This is a transitional state when the workload is being undeployed. Error An unknown error has occured.
Control panel (4)	The following control options are available: Play If the workload is in a stopped state, clicking Play will start the workload. Stop If the workload is running, clicking Stop will stop the workload. Suspend Clicking Suspend will pause the workload. It can be continued by clicking Play. Restart This will restart the workload.
Message window (5)	The message window displays the latest message the workload has sent out including a time stamp. The type of message that is displayed here depends on the workload. Messages for VMs and Docker containers: "Domain creating." "ERROR during creating! <errormessage>" "Domain starting." "ERROR during starting! <errormessage>" "Domain <domainname> started." "Domain stopping." "ERROR during stopping! <errormessage>" "Domain <domainname> stopped." "Domain suspending." "ERROR during suspending! <errormessage>" "Domain <domainname> suspended." "Domain resuming." "ERROR during resuming! <errormessage>" "Domain restarting." "ERROR during restarting." "Domain removing!!!" "ERROR during removing." "ERROR!!! Domain stopping." In the messages above, <domainname> is a placeholder for the name of the VM or Docker. In case of Docker containers, <errormessage> signifies a message that is generated by the Docker container if an error occurs. Additional set of messages for VMs only: "Failed to connect to hypervisor." "Failed to create domain." "Domain <domainname> created." "Cannot start <domainname> domain because it may already be running!" "Failed to resume <domainname> domain!" <errormessage> "Failed to start domain <domainname>. " <errormessage> In this case, <errormessage> is a message that is fetched from the libvirt library. Messages from CODESYS workloads: "Preparing files for installation" "Starting CODESYS application" "CODESYS application started" "Stopping CODESYS application" "CODESYS application stoppped" "Removing CODESYS application file" "An unexpected error has occurred. <errormessage>" Here, <errormessage> is a message that is sent between the node and CODESYS.
Usage statistics (6)	Virtual Machine workloads and Docker workloads have their assigned resources they can use. The use of these resources is displayed with bar graphs: CPU (VM and Docker) The percentage here shows the usage of CPU resources in relation to the assigned CPUs. Example: A VM is assigned one CPU core out of four and the core is at 75 % usage capacity. The graph will be at 75 %. RAM (Docker only) Similar to the CPU usage statistic, the percentage here shows the usage of system memory resources in relation to the assigned memory. If the assigned memory is at a 100 % usage capacity, the graph will be at 100 %. If no memory has been assigned, the graph will show the percentage of used memory in relation to the total available memory of the host.
Workload commands (7)	This area has a list of selectable items with different actions and features for workloads. Which commands appear in this list depends on the workload type. Some items are available for all workload types: CONNECT Selecting this opens an overlay, through which a remote connection to the workload can be established. Note that this item does not appear in the list if no remote connection has been defined. Refer to Remote Connections for more information. UNDEPLOY Selecting this removes the workload from the node. The tile in the node detail screen disappears. The workload can be deployed again from the deployment menu. Refer to Workload type specifics below for more information on workload specific commands and features.

Note

Since CODESYS workloads can only be controlled through the Local UI, the workload control screen does not offer any control options. It offers a message window. the option to undeploy the workload and the CONNECT button for establishing remote connections.

Workload type specifics

The table above covers the general workload control screen. Find below exclusive control options per workload type.

CODESYS workloads

Item	Description
UPDATE	Select this to open an overlay displaying all available versions of this workload. Note that the notification bubble displays the total number of available versions of this workload. Refer to Updating a deployed workload for more information.

Docker workloads

Item	Description
APPLY CONFIGURATION	This element only applies to Docker workloads with configuration storage defined. Selecting this allows the upload of configuration files. The configuration files have to be archived and uploaded in a ZIP file. For more information, refer to Applying configuration files to a workload below.
UPDATE	Select this to open an overlay displaying all available versions of this workload. Note that the notification bubble displays the total number of available versions of this workload. Refer to Updating a deployed workload for more information.

Virtual Machine workloads

Item	Description
RESOURCE ALLOCATION	The allocation of resources for Virtual Machine workloads can be modified while the workload is deployed and running on a node. This allows for balancing of resources when several Virtual Machine workloads are running on one node. For more information, refer to Changing resource allocation of a deployed Virtual Machine workload below.
NETWORK INFO	Select this to view information about networks attached to virtual machines in form of a read-only window. The information collected pertains the interface name, the source interface name on the Nerve host, the MAC address, the IP address, as well as the amount of received and transferred network data. Refer to Virtual machine network info below for more information.
SNAPSHOT	The current configuration of a virtual machine running in the Nerve system can be temporarily saved by taking a snapshot. One snapshot can be created at a time, either manually or through scheduling an automatic snapshot. They are designed to be temporary save states or fallbacks before a virtual machine is configured or updated. The process takes seconds or minutes and the result is a dynamically growing file stored on the Nerve Device. Note that snapshots are not persistent. If the workload is undeployed, the snapshot is lost. Refer to Virtual machine snapshots below for more information.
BACKUP	Saving a certain or optimal configuration of a virtual machine can be done with backups. Backups can only be created manually and they take much longer to create compared to snapshots. They are not designed to be done frequently. Backups are stored in a separate repository that needs to be defined by the user in the Local UI. The repository needs to be an NFS server that is accessible for the Nerve system. The repository for virtual machine backups can be shared between nodes, making the deployment of a VM backup to another node possible. Note that an NFS server needs to be set up first and made accessible for the Nerve Device. Once the NFS server is set up, connect to the Local UI and define the NFS server as the VM backup repository. NFS v3 and v4 are supported. Refer to Virtual machine backups below for more information.
VM VIDEO OPTIONS	The video output of Nerve Devices can be configured to directly output the interface of deployed virtual machines. This means that by connecting one or more monitors, a keyboard and a mouse, virtual machines can be operated directly at the Nerve Device. Note that the feature is not enabled by default and needs to be activated by Nerve service technicians. Refer to Virtual Machine video options below for more information.

Applying configuration files to a workload

Configuration files can be applied to deployed Docker workloads through the workload control screen. In this case, configuration files are files that the application in the Docker workload needs to perform a specific task. The nature of these files is completely dependent on the application. Therefore, these configuration files need to be prepared by the workload creator beforehand. They also need to be archived as a ZIP file so that they can be applied to a Docker workload using the Management System. Configuration files can be applied to the Docker workload while it is running, stopped or suspended.

Also, note that the workload needs to be properly configured before it is deployed in order to apply a configuration. At least one Docker volume for persistent storage needs to be defined, as well as marking the first volume as configuration storage. For more information, refer to Settings for Docker workloads.

Note

Note that this functionality is also available in the Local UI.

Select Nodes in the navigation on the left.
Select the node tree symbol.
Select a node with a deployed Docker workload from the node tree.
Select the tile of the Docker workload in the node details view on the right.
Select APPLY CONFIGURATION.
Select the plus icon to open the file browser.
Select the ZIP file containing the configuration files.
Select Open to add the ZIP file.
Select Apply.

A success message will pop up in the upper-right corner once the ZIP file has been applied. Also, a new message window labelled WORKLOAD CONFIGURATION is added. It includes the following information:

Item	Description
Timestamp	A timestamp in the format `M/DD/YYYY, h:mm:ss am/pm` is added next to WORKLOAD CONFIGURATION in the header of the workload configuration message window. This indicates the most recent time configuration files have been applied.
Container path	This is the path of the Docker volume that has been defined in the workload version settings before the deployment of the workload.
Volume name	This is the name of the Docker volume that has been defined in the workload version settings before the deployment of the workload.
Status	This indicates whether the files containing in the ZIP file have been successfully transferred to the Docker container.
Initiated by	Here the user is listed that applied the configuration files.

Changing resource allocation of a deployed Virtual Machine workload

The allocation of resources for Virtual Machine workloads can be modified while the workload is deployed and running on a node. This allows for balancing of resources when several Virtual Machine workloads are running on one node. Note that the workload automatically restarts in order to apply the changes.

Select Nodes in the navigation on the left.
Select the node tree symbol.
Select a node with a deployed Virtual Machine workload from the node tree.
Select the tile of the Virtual Machine workload in the node details view on the right.
Select RESOURCE ALLOCATION in the list.
Edit the values of Number of virtual CPUs and Limit memory to to the desired values.
Select Update.
Select Yes in the pop-up that appeared.

A green notification pops up in the upper-right and the Virtual Machine workload is automatically restarted to apply the changes.

Note

This functionality is also available in the Local UI. Log in to the Local UI and select Workload management in the navigation on the left. Select a Virtual Machine workload and follow the steps above.

Virtual machine network info

Information about networks attached to virtual machines can be looked into in form of a read-only window. Select NETWORK INFO in the workload control screen of a Virtual Machine workload to access the information. Here is how to reach the workload control screen in the Local UI and the Management System:

Location	Path
Local UI	Workload management > Select the VM workload tile.
Management System	Nodes > Select a node from the node tree that has a compatible virtual machine deployed. > Select the VM workload tile.

Here is an overview of the information shown.

Item	Description
INTERFACE NAME	Name of the virtual network device attached to the host interface.
SOURCE	This is the name of the Nerve network interface that was assigned when provisioning the workload. However, the name displayed here is the name of the interface on the host. This means bridged interfaces (`rtvm` and `isolated1-5`) will be displayed differently, i.e. `isolated1` will be displayed as `br-isolated1` etc.
MAC ADDRESS	MAC address assigned to the virtual network device.
IP ADDRESS	This is the IP address of the interface, either given by a DHCP server or set manually.
RECEIVED KB	Network data received since last VM workload start.
TRANSMITTED KB	Network data transferred since last VM workload start.

If there are no networks attached to the workload, the dialog will be empty.

Virtual machine video options

Note

The following feature is not enabled by default. The Nerve Device needs to be configured by service technicians first. Contact a sales representative or TTTech Industrial customer support to request this feature to be enabled. Note that there are two options: regular and grid display. Make sure to state the display mode when requesting the feature to be enabled.

The video output of Nerve Devices can be configured to directly output the interface of deployed virtual machines. This means that by connecting one or more monitors, a keyboard and a mouse, virtual machines can be operated directly at the Nerve Device. There are two display modes that can be chosen: regular and grid display. Note that only one of the two modes can be active. Refer to the images below for more information on possible VM display scenarios:

One monitor, multiple virtual machines, one at a time

Request regular display mode to use the feature this way. Press F8+Esc to switch between VMs. Determine the order of the VMs by changing the display order settings in the VM video options menu in the Management System.

One monitor, multiple virtual machines at once

Request grid display mode to use the feature this way. The maximum number of virtual machines that can be displayed is four. Determine the screen position of each VM by changing the display order settings in the VM video options menu in the Management System. All virtual machines can be operated by seamlessly moving the mouse pointer.

Two monitors, two virtual machines

Request regular display mode to use the feature this way. This scenario is only possible with Nerve Devices that have more than one video output. Determine the position of each VM by changing the display order settings in the VM video options menu in the Management System. Both virtual machines can be operated by seamlessly moving the mouse pointer.

Two monitors, multiple virtual machines

Request grid display mode to use the feature this way. This scenario is only possible with Nerve Devices that have more than one video output. Determine the screen position of each VM by changing the display order settings in the VM video options menu in the Management System. All virtual machines can be operated by seamlessly moving the mouse pointer.

Note

Connect a monitor to the Nerve Device before the Nerve Device is powered on. This is to avoid having to reboot the node once the VM video options are activated.

Make sure the user has the required permission to view the VM video options.
The permission is VM video output configuration. Refer to Editing a role for more information on changing the permissions of a role.
Select Nodes in the navigation on the left.
Select the node that has VM video options enabled from the node tree.
Select VM VIDEO OPTION in the node details view.
Tick the checkbox next to the VMs that shall have video output at the Nerve Device.
Use the arrows under Display order to define in which order the VMs shall be displayed.
Select Save.

The selected virtual machine will now be displayed at the video output of the Nerve Device. However, the VM display resolution might need to be adjusted inside of the VM to make the VM fit its portion of the screen. Note that the node needs to be restarted for the video output to be displayed if the node was already running when the monitor was connected. Also note that having video options enabled for a given virtual machine, makes VNC remote connections to that virtual machine not possible.

This feature is also available in the Local UI. Select Workload management in the navigation on the left and then select VM Video Option.

Virtual machine snapshots

The current state of a virtual machine running in the Nerve system can be temporarily saved by taking a snapshot. One snapshot can be created at a time, either manually or through scheduling an automatic snapshot. They are designed to be fallbacks before a virtual machine is updated or before its configuration is changed. The process takes seconds or minutes and the result is a dynamically growing file stored on the Nerve Device. Note that snapshots are not persistent. If the workload is undeployed, the snapshot is lost.

Note

Snapshots are supported only for VMs using the QCOW2 image format. Snapshots are not supported for virtual machines using IMG or RAW image files.
Keep in mind that by reverting a snapshot all changes occurred in the VM after the creation of the snapshot will be lost.

Enabling virtual machine snapshots

Snapshots are only available to virtual machine workloads using a QCOW2 image. So when following Provisioning a Virtual Machine workload, make sure to convert the resulting IMG file to QCOW2 and use the QCOW2 file when creating the workload in the Management System. For existing virtual machine workloads, convert the uploaded IMG or RAW file to QCOW2, replace it with the new QCOW2 and redeploy the VM workload. To enable snapshots in the Management System, follow the steps below:

Note

Snapshots cannot be taken for VM workloads that have an additional disk defined through the Management System.

Select Workloads in the navigation on the left.
Select a Virtual Machine workload with a workload version that uses a QCOW2 image.
Select the appropriate workload version.
Tick the checkbox next to Enable Snapshot.
Enter a value under Additional disk space to define additional disk space for the snapshot. The additional disk space depends on the defined memory for the VM, the VM disk size and should also include about 3% of overhead.

Note

Keep in mind the duration of how long the snapshot will be kept. The longer a snapshot is kept, the larger it will grow, requiring a larger amount of additional disk space. As an example, keeping a snapshot for a month could possibly double its size.
Select Update to save the changes.
Follow Deploying a workload to deploy the workload.

With snapshots enabled, they can be taken manually or automatically through scheduling an automatic snapshot.

Taking a virtual machine snapshot manually

Taking a snapshot is done from the workload control screen in the Local UI and the Management System. To reach the workload control screen, follow the paths below:

Location	Path
Local UI	Workload management > Select the VM workload tile.
Management System	Nodes > Select a node from the node tree that has a compatible virtual machine deployed. > Select the VM workload tile.

The SNAPSHOT option is located on the left side underneath the workload icon. Snapshots can be taken in any state — running, stopped or suspended.

Note

If a VM is running a heavy process before taking a snapshot, it is recommended to stop the VM before taking the snapshot. Data could be lost. For scheduled snapshots, set VM State to Stopped.

Select SNAPSHOT on the left to access the snapshot menu.
Select the plus icon in the upper-right.
Select Create to create the snapshot.
Optional: Enter a custom name or description to make the snapshot easier to identify.

The snapshot now appears in the list. Revert to a snapshot by selecting the Restore Snapshot symbol next to the snapshot. Delete a snapshot from the ellipsis by selecting DELETE from the ellipsis menu next to the snapshot details. Keep in mind that only one snapshot can be taken at a time.

Scheduling automatic snapshots

If taking snapshots is a recurring event or snapshots need to be taken in regular intervals, snapshots can be scheduled in the Local UI and the Management System. To reach the workload control screen, follow the paths below:

Location	Path
Local UI	Workload management > Select the VM workload tile.
Management System	Nodes > Select a node from the node tree that has a compatible virtual machine deployed. > Select the VM workload tile.

The SNAPSHOT option is located on the left side underneath the workload icon. Note that scheduled snapshots always delete existing snapshots before creating a new one.

Note

If a VM is running a heavy process, it is recommended to set the VM state to Stopped. Data could be lost when the snapshot is taken. For scheduled snapshots, set VM State to Stopped.

Select SNAPSHOT on the left to access the snapshot menu.
Select Interval or Day in the Schedule Type drop-down menu under Snapshot Schedule.

Note

In case of using an interval, note that the system does not keep memory of the already elapsed time. This means that after a node reboot, the interval timer is reset and the interval starts over according to the configured interval.

Fill in the values according to the selection:

Schedule Type	Description
Interval	hh Enter a numbered value. This is the interval in hours in between scheduled snapshots. VM State Current The status of the VM will not be changed while the snapshot is being taken. Stopped The running VM is stopped, the snapshot is taken, and the VM is started again.
Day	Day of the week Select a day of the week or Every day. hh:mm Click here to enter a time of day. VM State Current The status of the VM will not be changed while the snapshot is being taken. Stopped The running VM is stopped, the snapshot is taken, and the VM is started again.

Select Save.

Once the snapshot is taken at the scheduled time, it will appear in the list. Revert to a snapshot by selecting the Restore Snapshot symbol next to the snapshot. Delete a snapshot by selecting DELETE from the ellipsis menu next to the snapshot details. Disable the snapshot schedule by selecting Delete in the Snapshot schedule window. Keep in mind that the next scheduled snapshot is going to delete the existing snapshot since only one snapshot can be taken at a time.

Virtual machine backups

Saving a certain or optimal configuration of a virtual machine can be done with backups. Backups can only be created manually and they take much longer to create compared to snapshots. They are not designed to be done frequently. Backups are stored in a separate repository that needs to be defined by the user in the Local UI. The repository needs to be an NFS server that is accessible for the Nerve system. The repository for virtual machine backups can be shared between nodes, making the deployment of a VM backup to another node possible.

Note that an NFS server needs to be set up first and made accessible for the Nerve Device. Once the NFS server is set up, connect to the Local UI and define the NFS server as the VM backup repository. NFS v3 and v4 are supported.

Access the Local UI on the node. This is Nerve Device specific. Refer to the table below for device specific links to the Local UI. The initial login credentials to the Local UI can be found in the customer profile.

Nerve Device	Physical port	Local UI
MFN 100	P1	http://172.20.2.1:3333
Kontron KBox A-150-APL	LAN 1	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Kontron KBox A-150-APL chapter of the device guide.
Kontron KBox A-250	ETH 2	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Kontron KBox A-250 chapter of the device guide.
Maxtang AXWL10	LAN1	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Maxtang AXWL10 chapter of the device guide.
Siemens SIMATIC IPC127E	X1 P1	http://172.20.2.1:3333
Siemens SIMATIC IPC427E	X1 P1	http://172.20.2.1:3333
Supermicro SuperServer E100-9AP-IA	LAN1	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Supermicro SuperServer E100-9AP-IA chapter of the device guide.
Supermicro SuperServer 1019D-16C-FHN13TP	LAN3	http://172.20.2.1:3333
Supermicro SuperServer 5029C-T	LAN1	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Supermicro SuperServer 5029C-T chapter of the device guide.
Toshiba FA2100T-700	First rear port	http://172.20.2.1:3333
Vecow SPC-5600-i5-8500	LAN 1	http://172.20.2.1:3333
Winmate EACIL20	LAN1	`<wanip>:3333` To figure out the IP address of the WAN interface, refer to Finding out the IP address of the device in the Winmate EACIL20 chapter of the device guide.

Select Local repository in the navigation on the left.
Select the VM BACKUPS tab.

Enter the following information:

Field	Value
Protocol	The only available protocol is nfs.
Mount point (server:/backup_folder)	Enter the URL of the NFS server in the format `server:/backup_folder` that was set up before. The NFS server needs to be accessible for the Nerve system.
Options	Enter the list of mount options here. Mount options need to be separated by a comma. Refer to this link for NFS mounting options. Note that the following options are not considered by the system: rw (read/write) ro (read only) fg (foreground) bg (background) O (Overlay mount) remount

Select Save.

A green check mark appears next to the server address when the connection is successful.

Creating a virtual machine backup

VM backups are taken in a stopped state. The Nerve system will stop the VM automatically if it is not stopped manually before. Note that an NFS server needs to be set up and defined as a VM backup repository before creating a backup. To reach the workload control screen, follow the paths below:

Location	Path
Local UI	Workload management > Select the VM workload tile.
Management System	Nodes > Select a node from the node tree that has a virtual machine deployed. > Select the VM workload tile.

Select BACKUP in the list.
Select the plus icon in the upper-right.
Select Create.
Optional: Enter a name under Backup name to make the backup easier to identify.
Select Yes.

The backup creation process is now started. The duration of the backup creation depends on the size of the VM. It takes a considerable amount of time, as an identical copy of the VM is being created and transferred to the VM backups repository. A backup creation history is created and can be viewed in the UI.

Deleting a backup is done through connecting to the NFS server locally or remotely. Each VM backup consists of multiple files: image files, an XML and a JSON file. All files contained in the backup are listed in the JSON file containing the VM metadata.

Deploying a virtual machine backup

Backups can only be deployed in the Local UI. VM backups can be deployed at other nodes if they have the same VM backup repository set in the Local UI. Note that if an exact replica of a VM is desired, by keeping the original VM UUID and MAC address, the original VM needs to be undeployed first before deploying the backup.

Select Workload management in the navigation on the left.
Select the + tile to deploy a new workload.
Select the BACKUPS REPOSITORY tab.
Select a backup from the list.
Optional: Tick the checkbox next to Filter backups from this node to show backups that were created on the current node.

Note

When deploying a backup, the original VM UUID and MAC address can be preserved. Tick the checkbox next to Keep original VM UUID and MAC address to do so. In this case the original VM needs to be undeployed first, if it is still present on the node.
Select Deploy.

The VM backup will show up as a Virtual Machine workload in the workload management view once the deployment has finished.