Tech Stack You’ll Support
You will be deploying, scaling, and maintaining infrastructure for the following stack:

• Mobile applications built with Flutter.
• Web frontend built with React.
• Backend services built with Python (FastAPI).
• AI/ML workloads including LLM inference, RAG pipelines, and supporting services.
• Cloud platform: AWS (primary).
• Containerization with Docker; orchestration via ECS or EKS.
• Databases and storage: PostgreSQL/RDS, S3, vector stores, and caching layers (Redis).
  
  Key Responsibilities
• AWS Infrastructure
• Design, provision, and maintain AWS infrastructure across services including EC2, ECS/EKS, S3, RDS, VPC, IAM, CloudFront, Route 53, ELB/ALB, Lambda, and CloudWatch.
• Implement Infrastructure as Code (IaC) using Terraform, CloudFormation, or AWS CDK to ensure repeatable and version-controlled environments.
• Manage networking (VPCs, subnets, security groups, NAT gateways, VPN/peering) with a strong focus on security and least-privilege access.
• Optimize AWS spend through right-sizing, reserved instances/savings plans, autoscaling, and continuous cost monitoring.
• Docker & Containerization
• Build, optimize, and maintain Docker images for backend services, AI/ML workloads, and supporting tooling.
• Manage container orchestration on Amazon ECS (Fargate/EC2) or EKS (Kubernetes), including service definitions, task scaling, and rolling deployments.
• Maintain private container registries (ECR) with tagging, scanning, and lifecycle policies.
• Troubleshoot container-level issues across networking, storage, and runtime performance.
• CI/CD & Automation
• Build and maintain CI/CD pipelines using GitHub Actions, GitLab CI, Jenkins, or AWS CodePipeline / CodeBuild.
• Automate testing, container builds, image scanning, and zero-downtime deployments to staging and production environments.
• Standardize deployment workflows across services so engineers can ship safely and quickly.
• Monitoring, Reliability & Incident Response
• Implement and maintain observability across the stack using CloudWatch, Prometheus, Grafana, ELK/OpenSearch, Datadog, or similar.
• Define and track SLOs/SLAs, set up actionable alerting, and reduce noise in on-call workflows.
• Lead incident response, conduct root-cause analyses, and drive postmortems with clear follow-up actions.
• Plan and test backup, disaster recovery, and high-availability strategies.
• Security & Compliance
• Apply security best practices across IAM, secrets management (AWS Secrets Manager / Parameter Store), encryption at rest and in transit, and network security.
• Manage SSL/TLS certificates, WAF rules, and DDoS protection.
• Support compliance, audit, and data-protection requirements relevant to healthcare/AI workloads (e.g., data residency, access logging).
• Generative AI Infrastructure
• Support and maintain infrastructure for LLM and generative AI workloads on AWS, including Amazon Bedrock, SageMaker, and self-hosted model endpoints.
• Help manage GPU-based compute (EC2 P/G instances, Inferentia) for model inference and training workloads, with a focus on cost and throughput optimization.
• Set up and operate vector databases (OpenSearch, pgvector, Pinecone) and supporting RAG infrastructure.
• Build secure, observable pipelines for model deployment, versioning, and rollback.
• Monitor token usage, inference latency, and model-serving costs; implement guardrails and rate limiting where needed.
• Manage API gateways and authentication for AI endpoints exposed to internal and external consumers.
• Collaboration
• Work closely with backend, frontend, and AI/ML engineers to understand workload requirements and provide reliable infrastructure.
• Document infrastructure, runbooks, and operational procedures so the team can operate confidently.
• Mentor engineers on DevOps practices, deployment hygiene, and cloud-cost awareness.