How to deploy SmolLM2 1.7B on a Virtual Machine in the Cloud with Ollama?

and create an account. Once you've signed up, log into your account.

Follow the account setup process and provide the necessary details and information.

Navigate to the menu on the left side. Select the GPU Nodes option, create a GPU Node in the Dashboard, click the Create GPU Node button, and create your first Virtual Machine deployment.

Step 3: Select a Model, Region, and Storage

In the "GPU Nodes" tab, select a GPU Model and Storage according to your needs and the geographical region where you want to launch your model.

After choosing the image, click the 'Create' button, and your Virtual Machine will be deployed.

Step 7: Connect to GPUs using SSH

NodeShift GPUs can be connected to and controlled through a terminal using the SSH key provided during GPU creation.

Once your GPU Node deployment is successfully created and has reached the 'RUNNING' status, you can navigate to the page of your GPU Deployment Instance. Then, click the 'Connect' button in the top right corner.

Now open your terminal and paste the proxy SSH IP or direct SSH IP.

Step 8: Install SmolLM2 1.7B

After completing the steps above, it's time to download SmolLM2 1.7B from the Ollama website.

Website Link:

Then run the following command to install the Ollama:

curl -fsSL https://ollama.com/install.sh | sh



Next, run the following command to host the Llama 3.2 model so that it can be accessed and utilized efficiently.

ollama serve



Step 10: Run SmolLM2 1.7B Model

Now, you can run the model in the terminal using the following command and interact with your model:

ollama run smollm2:1.7b



daily.dev