181 lines
6.7 KiB
Markdown
181 lines
6.7 KiB
Markdown
### Step 1: Roadmap for Deployment, Testing, and Evaluation
|
||
|
||
#### Overview:
|
||
This roadmap will outline the steps to set up a Proxmox cluster, deploy various services, and test and evaluate the system’s performance. It will include setting up Proxmox on the old laptops and mini PCs, deploying services, and capturing knowledge and issues encountered.
|
||
|
||
#### Roadmap:
|
||
|
||
1. **Initial Setup and Configuration**:
|
||
- **Week 1**:
|
||
1. Gather hardware: 3 old laptops, 2 mini PCs (one for Opnsense firewall, one for hosting the website), and 2x16TB drives.
|
||
2. Install Proxmox VE on the old laptops and mini PCs.
|
||
3. Configure basic Proxmox settings and network.
|
||
|
||
2. **Basic Cluster Setup**:
|
||
- **Week 2**:
|
||
1. Create a Proxmox cluster with the old laptops.
|
||
2. Add the mini PCs to the cluster.
|
||
3. Set up storage with the 16TB drives for backups and shared storage.
|
||
|
||
3. **Service Deployment**:
|
||
- **Week 3-4**:
|
||
1. Deploy Opnsense firewall on one mini PC.
|
||
2. Set up a website hosting environment on the other mini PC.
|
||
3. Deploy various open-source services (e.g., Nextcloud, Home Assistant) for testing.
|
||
|
||
4. **High Availability Cluster Setup**:
|
||
- **Month 2**:
|
||
1. Purchase and set up 2 MINISFORUM UM690S Mini PCs.
|
||
2. Integrate these mini PCs into the Proxmox cluster.
|
||
3. Configure high availability settings and test failover capabilities.
|
||
|
||
5. **Benchmarking and Testing**:
|
||
- **Month 3**:
|
||
1. Perform initial benchmarks for compute, storage, and network performance.
|
||
2. Deploy small LLMs and perform load testing.
|
||
3. Capture performance metrics and analyze results.
|
||
|
||
6. **Documentation and Knowledge Capture**:
|
||
- **Ongoing**:
|
||
1. Document each step of the setup process.
|
||
2. Record any issues encountered and their resolutions.
|
||
3. Maintain a detailed log of configurations and settings.
|
||
|
||
### Detailed Directions for Initial Setup
|
||
|
||
#### Week 1: Gather Hardware and Install Proxmox
|
||
|
||
1. **Hardware Preparation**:
|
||
- Ensure all old laptops and mini PCs are functional.
|
||
- Format and prepare the 16TB drives for use as shared storage.
|
||
|
||
2. **Install Proxmox VE**:
|
||
- Download the latest Proxmox VE ISO from the official website.
|
||
- Create a bootable USB drive using a tool like Rufus.
|
||
- Boot each laptop and mini PC from the USB drive and follow the installation prompts to install Proxmox VE.
|
||
- Configure each installation with a unique hostname and appropriate network settings.
|
||
|
||
3. **Initial Configuration**:
|
||
- Access the Proxmox web interface on each device by navigating to `https://<IP_ADDRESS>:8006`.
|
||
- Set up user accounts and configure basic settings.
|
||
- Ensure all devices are on the same network and can communicate with each other.
|
||
|
||
#### Week 2: Create Proxmox Cluster
|
||
|
||
1. **Create a Proxmox Cluster**:
|
||
- On the primary Proxmox node (one of the laptops), create a new cluster:
|
||
```bash
|
||
pvecm create <cluster_name>
|
||
```
|
||
- On the other laptops and mini PCs, join the cluster:
|
||
```bash
|
||
pvecm add <IP_ADDRESS_OF_PRIMARY_NODE>
|
||
```
|
||
|
||
2. **Configure Shared Storage**:
|
||
- Add the 16TB drives to the Proxmox cluster as shared storage.
|
||
- Navigate to the Datacenter -> Storage in the Proxmox web interface and add the storage.
|
||
|
||
3. **Verify Cluster Setup**:
|
||
- Ensure all nodes appear in the cluster in the Proxmox web interface.
|
||
- Test basic functionality by creating and migrating a VM or container between nodes.
|
||
|
||
### Step 2: Project Plan and Sprint
|
||
|
||
#### Sprint 1: Initial Setup and Basic Cluster Configuration
|
||
|
||
- **Duration**: 2 Weeks
|
||
- **Goals**:
|
||
- Install Proxmox on all hardware.
|
||
- Configure basic settings and network.
|
||
- Create and verify the Proxmox cluster.
|
||
|
||
#### Sprint 2: Service Deployment
|
||
|
||
- **Duration**: 2 Weeks
|
||
- **Goals**:
|
||
- Deploy Opnsense firewall and website hosting environment.
|
||
- Set up and test various open-source services.
|
||
- Document configurations and issues.
|
||
|
||
#### Sprint 3: High Availability Cluster Setup
|
||
|
||
- **Duration**: 1 Month
|
||
- **Goals**:
|
||
- Purchase and set up MINISFORUM UM690S Mini PCs.
|
||
- Integrate new hardware into the cluster.
|
||
- Configure and test high availability settings.
|
||
|
||
#### Sprint 4: Benchmarking and Testing
|
||
|
||
- **Duration**: 1 Month
|
||
- **Goals**:
|
||
- Perform benchmarks for compute, storage, and network performance.
|
||
- Deploy and test small LLMs.
|
||
- Capture and analyze performance metrics.
|
||
|
||
### Step 3: Git Structure
|
||
|
||
# Home Lab and Small Data Center Project
|
||
|
||
## Goals and Objectives
|
||
|
||
This project aims to build a cost-effective, scalable home lab and small data center to support a startup offering localized IT services. The infrastructure will host various services, including network management, data backups, home automation, security monitoring, and AI workloads.
|
||
|
||
## Objectives
|
||
- Set up a Proxmox cluster using old laptops and mini PCs.
|
||
- Deploy and test various open-source services.
|
||
- Benchmark and evaluate compute, storage, and network performance.
|
||
- Scale the infrastructure by adding MINISFORUM UM690S Mini PCs.
|
||
- Ensure high availability and robustness of the system.
|
||
|
||
## Project Plan
|
||
- **Sprint 1**: Initial Setup and Basic Cluster Configuration
|
||
- **Sprint 2**: Service Deployment
|
||
- **Sprint 3**: High Availability Cluster Setup
|
||
- **Sprint 4**: Benchmarking and Testing
|
||
|
||
## Getting Started
|
||
1. **Install Proxmox VE** on all hardware.
|
||
2. **Create a Proxmox Cluster** and add all nodes.
|
||
3. **Deploy Services** and test functionality.
|
||
4. **Configure High Availability** and test failover.
|
||
5. **Benchmark and Evaluate** performance.
|
||
|
||
## Repository Structure
|
||
```
|
||
home-lab-project/
|
||
├── README.md
|
||
├── docs/
|
||
│ ├── setup/
|
||
│ │ ├── proxmox_installation.md
|
||
│ │ ├── cluster_configuration.md
|
||
│ │ └── service_deployment.md
|
||
│ ├── benchmarks/
|
||
│ │ ├── compute.md
|
||
│ │ ├── storage.md
|
||
│ │ └── network.md
|
||
│ ├── issues/
|
||
│ │ └── issue_log.md
|
||
│ └── future_expansion.md
|
||
├── scripts/
|
||
│ ├── benchmarks/
|
||
│ │ ├── compute_benchmark.sh
|
||
│ │ ├── storage_benchmark.sh
|
||
│ │ └── network_benchmark.sh
|
||
│ └── deployment/
|
||
│ ├── deploy_services.sh
|
||
│ └── configure_ha.sh
|
||
└── logs/
|
||
└── setup_log.md
|
||
```
|
||
|
||
1. **docs/**: Documentation for setup, configuration, benchmarks, and future expansion.
|
||
2. **scripts/**: Scripts for benchmarking and service deployment.
|
||
3. **logs/**: Logs of setup steps, configurations, and issues encountered.
|
||
|
||
### Next Steps
|
||
1. **Review and refine** the roadmap, project plan, and README structure.
|
||
2. **Start with Sprint 1**: Initial Setup and Basic Cluster Configuration.
|
||
3. **Document** each step thoroughly and capture any issues encountered.
|