Skip to content

Magic Castle Deployment Guide - #48

Open
Vismayak wants to merge 2 commits into
mainfrom
41-upload-magic-castle-config-with-documentation-in-devops-folder
Open

Magic Castle Deployment Guide#48
Vismayak wants to merge 2 commits into
mainfrom
41-upload-magic-castle-config-with-documentation-in-devops-folder

Conversation

@Vismayak

@Vismayak Vismayak commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

This pull request introduces infrastructure-as-code for deploying LLMHub on an HPC cluster using Magic Castle. It adds a new Terraform configuration (main.tf) and comprehensive documentation to guide users through provisioning and managing the cluster on OpenStack/Radiant. The configuration provisions a Slurm-based cluster with GPU nodes, storage, and optional public access via a Caddy reverse proxy, while the documentation explains setup, customization, and security considerations.

New Magic Castle-based deployment for LLMHub:

  • Added a detailed README.md describing the Magic Castle setup, deployment instructions, file purposes, customization steps, SSH access, and security best practices.
  • Introduced main.tf, a Terraform configuration defining the cluster topology (Slurm controller, login node, GPU compute nodes, NFS storage), user management, and optional Caddy reverse proxy for public access.

Customization and security guidance:

  • Provided clear instructions for adapting the configuration to different OpenStack projects, including which parameters to change and where to source required modules.
  • Emphasized not to commit secrets or state files, and explained how to safely set credentials and manage sensitive information.

Integration with related LLMHub infrastructure:

  • Linked to related directories for Apptainer image builds and backend configuration, ensuring users can connect the deployment to the rest of the LLMHub stack.

Created using Claude and personal notes taken on Notion

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a Magic Castle–based deployment path for running LLMHub on an OpenStack-backed HPC-style Slurm cluster, including an example Terraform configuration and an end-to-end operational guide.

Changes:

  • Added Terraform main.tf describing a Slurm + FreeIPA + NFS + login/proxy + GPU node topology for Magic Castle.
  • Added documentation (README.md, DEPLOYMENT_GUIDE.md) covering provisioning, verification, LLMHub install/run steps, and security notes.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 4 comments.

File Description
devops/magic_castle/README.md Entry-point documentation describing what the Magic Castle config is and how to use it.
devops/magic_castle/main.tf Example Terraform configuration for Magic Castle OpenStack deployment, plus outputs and optional DNS/proxy blocks.
devops/magic_castle/DEPLOYMENT_GUIDE.md Detailed walkthrough for deploying the cluster and installing/running LLMHub on it.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

}
}

public_keys = [file("~/.ssh/id_ed25519.pub")]
Comment thread devops/magic_castle/main.tf
Comment on lines +68 to +70
output "accounts" {
value = module.openstack.accounts
}
Comment on lines +363 to +364
Install Node 22 and pnpm on the login node, then build:

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Upload Magic Castle Config with Documentation in Devops Folder

2 participants