How To Create a New Linux VM With NVIDIA Virtual GPU in the OpenStack Dashboard Horizon on 3Engines Cloud[🔗](#how-to-create-a-new-linux-vm-with-nvidia-virtual-gpu-in-the-openstack-dashboard-horizon-on-brand-name "Permalink to this headline")
===================================================================================================================================================================================================================================================

You can create Linux virtual machine with NVIDIA RTX A6000 as the additional graphics card. The card contains

> * 10,752 CUDA cores for rendering, graphics operations and heavy parallel computations,
> * 336 Tensor cores which accelerate AI and data science model training, while
> * 84 RT cores speed up ray tracing with shading or denoising, photorealistic rendering and so on.

There are four variants, using 6, 12, 24, or 48 GB of VGPU RAM. You will be able to select the particular model by choosing a proper flavor when creating the instance in Horizon (see below).

What We Are Going To Cover[🔗](#what-we-are-going-to-cover "Permalink to this headline")
---------------------------------------------------------------------------------------

> * How to create an instance with NVIDIA support
> * How to choose the proper flavor for the data in hand
> * How to add proper keypair in order to
> * SSH into the virtual machine you create, or
> * use the console within Horizon interface and
> * verify that you are using the NVIDIA vGPU.

Step 1 Create New Instance with NVIDIA Image Support[🔗](#step-1-create-new-instance-with-nvidia-image-support "Permalink to this headline")
-------------------------------------------------------------------------------------------------------------------------------------------

To define a new instance, use the following series of commands:

> **Project → Compute → Instances.**

![compute_instances.png](../_images/compute_instances.png)

Click **Launch Instance** to get the following screen:

![launch_instance.png](../_images/launch_instance.png)

Insert the name of the instance (eg. “vm\_with\_vgpu”) and click Next button. In the next screen, you will choose the operating system for the new virtual machine you are defining:

![choose_os.png](../_images/choose_os.png)

Your goal is to use an image with predefinced NVIDIA support. To list all such images, click on field **Available** and enter ‘NVIDIA’ into it. Only the images with NVIDIA in their names will be listed:

![nvidia_chosen_3Engines_cloud.png](../_images/nvidia_chosen_3Engines_cloud.png)

Select Instance Boot Source (eg. “Image”), and choose desired image (eg. “Ubuntu 20.04 NVIDIA”) by clicking on arrow.

Images marked with “NVIDIA” are fully operational. They come preinstalled with

> * special NVIDIA Grid drivers
> * a licence token, as well as
> * the CUDA library.

Note

If you do not need to have the system disk bigger than the size defined in a chosen flavor, we recommend setting “Create New Volume” feature to “No” state.

Click on the Next button and get to the following screen:

![createnew18.png](../_images/createnew18.png)

You will now choose one of the four models of the RTX A6000 card.

Step 2 Select Card Model / Flavor[🔗](#step-2-select-card-model-flavor "Permalink to this headline")
---------------------------------------------------------------------------------------------------

The four available: **RTXA6000-6C**, **RTXA6000-12C**, **RTXA6000-24C**, and **RTXA6000-48C**, are described in this table:

![createnew16.png](../_images/createnew16.png)

The column VM Name contains flavor names *vm.a6000.1*, *vm.a6000.2*, *vm.a6000.4*, *vm.a6000.8*. Again, type *a6000* into the field **Available** and list only the NVIDIA flavors:

![createnew19.png](../_images/createnew19.png)

Taking into account the data from the table above, if you select flavor *vm.a6000.2*, you will use **4** virtual cores and **28** GB of “normal” RAM, and simultaneously, you will also choose the **RTXA6000-12C** model with **12** GB of virtual GPU RAM.

Note

Yellow triangles in the listing mean that you cannot select that row as one of the system resources is already engaged to other instances. If you, say, wanted to select the strongest flavor of NVIDIA, *vm.a6000.8*, you would first have to obtain 112 GB or more of available of RAM and only then be able to opt for that flavor.

In the situation above, select *vm.a6000.2* and continue going through the usual motions of selecting instance elements to finish the procedure.

Step 3 Finish Creating the Instance[🔗](#step-3-finish-creating-the-instance "Permalink to this headline")
---------------------------------------------------------------------------------------------------------

Click “Networks” and then choose desired networks.

![networks5.png](../_images/networks5.png)

Open “Security Groups” After that, choose “allow\_ping\_ssh\_icmp\_rdp” and “default”.

![createnew6.png](../_images/createnew6.png)

Choose or generate SSH keypair, as explained in article [How to create key pair in OpenStack Dashboard on 3Engines Cloud](How-to-create-key-pair-in-OpenStack-Dashboard-on-3Engines-Cloud.html.md) for your VM. Next, launch your instance by clicking on blue button.

![createnew7.png](../_images/createnew7.png)

You will see “Instances” menu with your newly created VM.

![createnew8.png](../_images/createnew8.png)

Note

If you want to make your VM accessible from the Internet, see this article: [How to Add or Remove Floating IP’s to your VM on 3Engines Cloud](../networking/How-to-Add-or-Remove-Floating-IPs-to-your-VM-on-3Engines-Cloud.html.md)

Step 4 Issue Commands from the Console[🔗](#step-4-issue-commands-from-the-console "Permalink to this headline")
---------------------------------------------------------------------------------------------------------------

Open the drop-down menu and choose “Console”.

![createnew9.png](../_images/createnew9.png)

You can connect to your virtual machine using SSH, see this article: [How to connect to your virtual machine via SSH in Linux on 3Engines Cloud](../networking/How-to-connect-to-your-virtual-machine-via-SSH-in-Linux-on-3Engines-Cloud.html.md)

You can also use the SPICE console using the Openstack Dashboard.

Click on the black terminal area (to activate access to the console). Type:

```
eoconsole

```

and hit Enter on the keyboard.

![createnew10.png](../_images/createnew10.png)

Insert and retype new password.

![createnew11.png](../_images/createnew11.png)

Now you can type commands.

![createnew12.png](../_images/createnew12.png)

To check the status of the **vGPU** device, enter the command:

```
nvidia-smi

```

![createnew13.png](../_images/createnew13.png)

After you finish, type “exit”.

```
exit

```

![createnew14.png](../_images/createnew14.png)

This will close the session.