Skip to content

raoulg/surfcontroller

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

84 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿ„โ€โ™‚๏ธ Surf Controller

๐ŸŒŠ Overview

Surf Controller is a powerful CLI tool for managing your cloud workspaces with ease! It provides a user-friendly interface to monitor, pause, and resume your virtual machines (VMs) effortlessly.

๐Ÿš€ Features

  • ๐Ÿ“Š Interactive CLI interface
  • ๐Ÿ”„ Real-time VM status updates
  • โธ๏ธ Pause and โ–ถ๏ธ resume VMs with a single keystroke
  • ๐Ÿ“‹ Multi-select functionality for batch operations
  • ๐Ÿ“œ Live log viewing

๐Ÿ› ๏ธ Installation

config dir

By default, your ~/.surf_controller/ dir will be used for data. You can modify this by specifying SURF_CONTROLLER_CONFIG_DIR in your env, eg

export SURF_CONTROLLER_CONFIG_DIR=/srv/shared/

You can do this for the server for all users with

sudo vim /etc/profile.d/shared_env.sh

install as tool

Use uv to install surf-controller globally or add it to your local environment. You can install it with curl -LsSf https://astral.sh/uv/install.sh | sh . Of course, you can also use pip to install it (but then you might also need to install python etc, something uv also takes care of). Here are three different commands you could use, the first one (uv tools) is recommended to install it globally. Dont run all three, pick one.

option 1

install globally

uv tools install surf-controller

option 2

install in a .venv

uv add surf-controller

option 3

Install with pip if you get nervous from new tools

pip install surf-controller

All three commands install the surfcontroller command; if you dont know what to pick, use uv

๐Ÿ”‘ First-time Setup of tokens

You can find the SURF API documentation here: API Documentation

On your profile you can create your own API token.

You can obtain the CSRF tokens by authorizing directly with the Surf API. Use the green lock icon in the top right corner to authorize with your API-token and obtain the CSRF token by executing a request.

Copy both tokens and use them during configuration.

Run the configuration by starting the controller:

surfcontroller

On first run, Surf Controller will:

  1. ๐Ÿ“ Create a configuration directory in your SURF_CONTROLLER_CONFIG_DIR folder (defaults to ~)
  2. ๐Ÿ“„ Copy a default configuration file into your configdir
  3. ๐Ÿ”’ Prompt you for API and CSRF tokens and stores them in your configdir

๐ŸŽฎ Usage

Run the controller:

surfcontroller

๐Ÿ•น๏ธ Controls

navigate / select

  • j: Move cursor down
  • k: Move cursor up
  • J: Next page
  • K: Previous page
  • Enter: Select/deselect VM
  • a: toggle Select all VMs
  • f: toggle Filter VMs (by username)
  • R: toggle Filter Running VMs (show only running)
  • 1-9: Toggle custom filters
  • +: Add custom filter
  • n: rename username
  • l: toggle view logs

Actions

  • p: Pause selected VMs
  • r: Resume selected VMs
  • e: Batch update End Date for selected VMs
  • E: Toggle Pause Exclusion (Shift+e)
  • c: Bulk Create VMs (Wizard)
  • d: Bulk Delete selected VMs (with confirmation)
  • u: Update VM list
  • s: ssh into selected VM (select just one VM)

How to create your own templates

It is a bit hacky, but i follow these steps:

  • Go to your SRC workspaces dashboard
  • Manually, create a new VM with the settings (wallet, colab, type, etc) you want to use as a template
  • Get the id of the VM from your dashboard.
  • Go to the swagger docs and run the GET /v1/workspace/workspaces/{id}/ request with the id of your VM.
  • You can have a look at the tempaltes/example.json i provided. You should replace all the tags that have <...> with your own values.
  • Keep the three values with placeholder-..., surfcontroller will replace these when creating VMs.

I created three templates for different colabs: ubuntu-8GBRAM, ubuntu-16GBRAM and ubuntu-GPU. I am planning on improving the templates in the future, to make them more flexible.

โœจ New in v1.0

  • Bulk Creation Wizard: Press c to launch a step-by-step wizard for creating multiple VMs from a user list and template.
  • Bulk Deletion: Press d to delete multiple VMs at once. Includes a safety confirmation dialog.
  • Batch End Date Update: Press e to update the expiration date for multiple VMs simultaneously.
  • Running Filter: Press R to quickly see only your running VMs.
  • UI Improvements:
    • Progress Bars: Visual progress tracking for batch operations.
    • Status Indicators: Clear "OK" (Green) or "FAILED" (Red) status for actions.
    • Responsive Footer: Command bar adapts to screen width.
    • Persistent Filters: Custom filters are saved between sessions.

Note that adding to the exclusion list only adds the id of the vm to exclusions.json. The actual shutting down of the VM is done from a VM we control on the Surf cloud, so toggling this on your computer doesnt impact the actual pausing at 21:00.

๐Ÿ“ Configuration

Edit ~/.surf_controller/config.toml to customize your settings.

๐Ÿค Contributing

Contributions are welcome!

๐Ÿ“œ License

This project is licensed under the MIT License - see the LICENSE file for details.

๐Ÿ™ Acknowledgments

๐Ÿ“… Scheduler & Web GUI

The project includes a Docker-based scheduler for automating nightly VM pauses and managing exclusions via a Web GUI.

Setup

  1. Navigate to the scheduler/ directory:
    cd scheduler
  2. Create a .env file from the sample:
    cp .env.sample .env
    Edit .env to set your desired WEB_USERNAME and WEB_PASSWORD.
  3. Start the scheduler:
    docker-compose up -d --build

How it works

  • Web GUI: Accessible at http://localhost:5001. Use it to view VM status, toggle exclusions, and manually trigger the pause job.
  • Nightly Job: A cron job runs every night at 21:00 to pause all non-excluded VMs.
  • Configuration: The scheduler mounts your local ~/.surf_controller directory, so it shares the same tokens and exclusions as the CLI tool.
  • Installation: The Docker image installs the surf-controller package directly from the source code in the parent directory, ensuring it always runs the latest version of your code.

๐Ÿš€ Deployment

To deploy the scheduler to a remote machine, you can use the automated deployment script:

python3 scheduler/deploy.py

This script will:

  1. Configure Environment: Check/create scheduler/.env, generate a secure WEB_PASSWORD if needed, and prompt for the DEPLOY_HOST.
  2. Build & Push: Build the Docker image for linux/amd64 and push it to Docker Hub.
  3. Deploy Files: SCP the .env and docker-compose.deploy.yml to the remote server.
  4. Restart Service: SSH into the remote server and restart the Docker service.

If you open port 5001, you will have a GUI dashboard to exclude VMs from pausing. so: http://123.45.67.89:5001 where 123.45.67.89 is the IP of your remote server.

Prerequisites:

  • SSH access to the remote host (default rgrouls@123.45.67.89) via key-based authentication.
  • Docker installed and running locally.

About

A CLI app to controll SURF virtual machines

Resources

License

Stars

Watchers

Forks

Packages

No packages published