How to deploy QwQ 32B Preview in the Cloud?

and create an account. Once you’ve signed up, log into your account.

Follow the account setup process and provide the necessary details and information.

Navigate to the menu on the left side. Select the GPU Nodes option, create a GPU Node in the Dashboard, click the Create GPU Node button, and create your first Virtual Machine deployment.

Step 3: Select a Model, Region, and Storage

In the “GPU Nodes” tab, select a GPU Model and Storage according to your needs and the geographical region where you want to launch your model.

After choosing the image, click the ‘Create’ button, and your Virtual Machine will be deployed.

Step 7: Connect to GPUs using SSH

NodeShift GPUs can be connected to and controlled through a terminal using the SSH key provided during GPU creation.

Once your GPU Node deployment is successfully created and has reached the ‘RUNNING’ status, you can navigate to the page of your GPU Deployment Instance. Then, click the ‘Connect’ button in the top right corner.

Now open your terminal and paste the proxy SSH IP or direct SSH IP.

Step 8: Install Ollama

After completing the steps above, it’s time to download Ollama from the Ollama website.

Website Link:

After the installation process is complete, run the following command to see a list of available commands:

ollama

Step 9: Check the Sizes of QwQ Model

On the Ollama website, the QWQ model is available in five different sizes. We will pull and run all the sizes on our GPU virtual machine.

Step 11: Run qwq:32b Model

Now, you can run the model in the terminal using the following command and interact with your model:

ollama run qwq:32b

Step 12: Pull qwq:32b-preview-fp16 Model

To pull the qwq:32b-preview-fp16 model, run the following command:

ollama pull qwq:32b-preview-fp16

Step 14: Pull qwq:32b-preview q4 K M Model

To pull the qwq:32b-preview-q4_K_M model, run the following command:

ollama pull qwq:32b-preview q4 K M

daily.dev