Back to Document Summarizer
Document ProcessingLlama 3 (70B)
Document Summarizer Using Llama 3 (70B)
Optimized prompts and cost breakdowns for running document summarizer with Llama 3 (70B).
About Llama 3 (70B)
- Provider
- meta
- Context Window
- 8K tokens
- Input Cost
- $0.9 / 1M tokens
- Output Cost
- $0.9 / 1M tokens
Best For
Self-hostingOpen sourcePrivacy
Optimized Prompts for Llama 3 (70B)
These prompts are tailored to work best with Llama 3 (70B)'s capabilities
basic
Summarize the following document in 3-5 bullet points, focusing on the key takeaways:
{{document_text}}detailed
Create a comprehensive summary of the following document. Include:
- Executive summary (2-3 sentences)
- Key points (5-7 bullets)
- Action items (if any)
- Important dates or deadlines
{{document_text}}Cost Breakdown
Estimated costs for running this workflow with Llama 3 (70B)
- input tokens
- ~1217 tokens
- output tokens
- ~302 tokens
- cost per request
- $0.0360
- monthly 1000 requests
- $12.00
Rate Limiting Considerations
Meta has rate limits of approximately 8138 RPM. Consider implementing request queuing for high-volume usage.
Monitoring with Administrate
Track Llama 3 (70B) API latency and error rates. Set up alerts for rate limit warnings and cost thresholds.