LLM Cloud Infrastructure for ChatGPT Fine-tuning:
Duration: Pay-as-you-go
Considerations:
- In my past experience GPT-4.1 mini is the sweet spot for cost and
performance efficiency.
- We can also use GPT-4.1 nano for semi real-time applications that
need low latency.
- The costs in this license request sheet are only an estimate. I had
not contacted Microsoft and Google sales team yet.
- We should present a use-case to the team about why fine-tuning is
necessary and vanilla LLM models don’t achieve the requirements.
- We can deploy this system reasonably fast within wet design and
start the fine-tuning work.
- Since the GPT endpoint remains within AzureOpenai instead of API
based Openai, we can perform our own data governance and have a highly
secure system that wouldnt expose Wet desing data to external
entities.
- This architecture is future-proof and uses the best technologies as
used by major corporations and suggested by data science major
players.

Fig1. Proposed System design diagram
Licenses that we need:
Microsoft Azure Subscription Requirements:
- Azure Document Intelligence service license
- Azure OpenAI Service access (with special approval requirement
highlighted)
- Azure AI Search service license Clarification that there are no
per-user licensing fees
Google Cloud Platform Requirements:
- Google Cloud Storage API access
- Google BigQuery service license No per-user licensing fees
Estimated Monthly Costs (Usage-Based):
- High-Performance: $500-2,000/month - GPT-4.1 Full
with PTU hosting
- Balanced: $50-400/month - GPT-4.1 Mini with
pay-as-you-go
- Cost-Optimized: $30-200/month - GPT-4.1 Nano with
pay-as-you-go
Note: Costs depend heavily on actual usage volumes
(pages processed, tokens consumed, search queries)
Recommendation: We can start with Balanced scenario
using GPT-4.1 Mini, monitor usage, and adjust.
Service Pricing Models (Usage-Based)
Azure OpenAI GPT-4.1 Models
All pricing per 1 million tokens (regional variations
apply):
| GPT-4.1 Nano |
~$0.10/1M |
~$0.40/1M |
~$0.025/1M |
High-volume simple tasks |
| GPT-4.1 Mini |
~$0.40/1M |
~$1.60/1M |
~$0.10/1M |
Production apps |
| GPT-4.1 Full |
~$2.00/1M |
~$8.00/1M |
~$0.50/1M |
Maximum accuracy |
Batch API Discount: 50% off standard rates for
asynchronous processing
Azure Document Intelligence (OCR)
Pricing: ~$1.50 per 1,000 pages processed
- Usage estimate needed: How many pages per
month?
- Example: 10,000 pages/month = $15/month
- Free tier: First 500 pages per month free
Azure AI Search
- Pricing: SKU-based per Search Unit (SU) per
hour
- Basic: ~$0.10/hr per SU × 730 hours = ~$73/month
(50GB capacity)
- Standard S1: ~$0.33/hr per SU × 730 hours =
~$241/month (160GB capacity)
- Cost scales with: Replicas × Partitions × Base SU
cost
- 100GB requirement: Fits in 1× S1 Search Unit
Google Cloud Storage (1TB)
- Pricing: ~$0.020-0.026 per GB per month (regional
variance)
- Estimated cost: $20-26/month for 1TB
- Additional costs: Operations charges, egress fees
(region-dependent)
- Usage estimate needed: Monthly operations volume
and data transfer
Google BigQuery (500GB)
- Storage: ~$0.02 per GB per month for active logical
storage
- 500GB storage cost: ~$10/month (first 10GB
free)
- Query processing: $6.25 per TiB of data processed
(1TB/month free on many accounts)
- Usage estimate needed: Monthly query volume in
TiB
Procurement Requirements
Microsoft Azure Subscription
- Services: Document Intelligence, OpenAI Service, AI
Search
- Critical: Submit Azure OpenAI access
application
- Billing: Pay-as-you-go based on actual usage
- Budget range: $50-2,000/month depending on usage
and model selection
User Access
- 4 user accounts with appropriate permissions
- No additional per-user licensing costs
Key Decisions & Cost Drivers
Critical Decision: Model Selection & Usage Pattern
GPT-4.1 Model Choice: - Nano: 4×
cheaper per token, suitable for simple tasks - Mini:
Balanced performance, fine-tuning support - Full:
Maximum accuracy, PTU hosting available for guaranteed capacity
Usage Pattern Impact: - High token
volumes: Consider PTU hosting for predictable costs -
Batch workloads: Use Batch API for 50% savings -
Repeated prompts: Leverage 75% caching discount
Cost Variables to Monitor
- Token consumption (biggest variable cost)
- Document processing volume (pages per month)
- Search query patterns (affects AI Search
scaling)
- BigQuery analysis frequency (TiB processed
monthly)
Cost Control
- Usage alerts on Azure and Google Cloud
accounts
- Monthly budget limits per service
- Automatic scaling policies for AI Search
- Regular usage reviews to optimize model
selection
Ordering Process
Azure Services
- Contact: Microsoft Account Manager
- Special approval: Submit Azure OpenAI Service
access request immediately
- Setup: Pay-as-you-go billing account
- Timeline: 2-3 weeks for OpenAI access approval
Google Cloud Services
- Setup: Create account with corporate billing
- Enable APIs: Cloud Storage, BigQuery
- Timeline: 1-3 business days
Budget Planning Scenarios
Based on common usage patterns:
Light Usage (Pilot/Development)
- 5M input + 2M output tokens monthly (Mini)
- 5,000 pages OCR
- Basic AI Search
- Estimated monthly cost: $80-150
Medium Usage (Production)
- 20M input + 10M output tokens monthly (Mini)
- 20,000 pages OCR
- Standard AI Search
- Estimated monthly cost: $300-500
Heavy Usage (Enterprise Scale)
- 50M+ tokens monthly
- 50,000+ pages OCR
- Premium AI Search with replicas
- Estimated monthly cost: $1,000-3,000+