English
English Indonesia Türkçe Deutsch Español Português Pусский Français Italiano Nederlands Polski العربية ไทย Tiếng Việt 繁體中文 简体中文 日本語 한국어

#promptcaching search results

0xGagan's profile picture. A self-made techpreneur who's here to tweet anything I like...
Gagan Deep Singh
 @0xGagan
Oct 3, 2024

🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.

0xGagan's tweet image. 🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.
1
0
3
0
31
RasmusToivanen's profile picture. More generalist than specialist. Industrial engineer turned into ML. Currently AI CTO @RecordlyData. Training Finnish-LLMs end-to-end with @aapo_tanskanen
Rasmus Toivanen
 @RasmusToivanen
Nov 5, 2024

Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI

RasmusToivanen's tweet image. Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI
0
0
1
0
79
ramessarwat's profile picture. Passionate about technology and innovation. I tweet about artificial intelligence, cybersecurity, blockchain and gadgets
Rames
 @ramessarwat
Oct 24, 2024

OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2

ramessarwat's tweet image. OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2
0
0
0
0
30
CloudCostChefs's profile picture. 🍳 CloudCostChefs: free, no-BS recipes that slice 15-30 % off your cloud bill. #FinOps for engineers across Azure, OCI & multi-cloud. Grab the 90-day checklist
CloudCostChefs
 @CloudCostChefs
Nov 10

Claude API Prompt Caching 👨🍳 90% cost reduction ✅ 80% latency reduction ✅ Cache prompts for 1 hour ✅ Stop reprocessing the same context over and over. Prep once, reuse all day 💰 🍲 cloudcostchefs.com #FinOps #PromptCaching #CloudCostChefs

cloudcostchefs.com

CloudCostChefs - Democratizing FinOps

Free tools and resources to optimize cloud costs for everyone

Source: cloudcostchefs.com
0
0
0
0
14
clipper_video's profile picture. CUBE365 makes it quick and easy to find, create and share snackable clips from long-form videos--without any special video editing skills or tools
CUBE365 Clips
 @clipper_video
Jul 10

Prompt caching in Amazon Bedrock enhances agent efficiency and reduces costs by up to 90% for Claude and Nova models. #PromptCaching #AgentUseCases #AmazonBedrock #AIModels #ClaudeModels #NovaModels #TokenCaching #TechInnovation #AIPerformance video.cube365.net/c/976531

0
0
0
0
16
gujral_raman5's profile picture. Group Product Director - AI & Monetization @US based Fintech - I talk about sports, movies,travel stock markets, product management, and corporate life.
Raman Gujral
 @gujral_raman5
Jun 11

So, in the above example, caching made the system 3 times faster and 3 times cheaper to run. #promptcaching #AIagents #Agenticframework #GenAI #AIproductmanagement #AIproductmanager #ArtificialIntelligence #AIlearnings

0
0
0
0
12
clipper_video's profile picture. CUBE365 makes it quick and easy to find, create and share snackable clips from long-form videos--without any special video editing skills or tools
CUBE365 Clips
 @clipper_video
Jul 10

Applications of generative AI are evolving toward asynchronous responses, shifting from immediate needs to more agentic, complex interactions. #GenerativeAI #AIApplications #PromptCaching #CustomerCare #AITrends #TechInnovation #AIUseCases video.cube365.net/c/976533

0
0
0
0
5
VHurezeanu's profile picture. Better your best! Full-time dentist, free-time crypto and ultra-marathon enthusiast!
Sats0mNIaK
@VHurezeanu
Mar 25

⚡️ $Prompt caching? It’s AI magic—storing query results on-chain to slash costs and boost speed. @AIWayfinder is integrating this into Web3, making it a dev’s dream. Paired with $PROMPT staking, it’s a utility powerhouse. #PromptCaching #Web3

1
0
1
0
25
managetech_inc's profile picture. 株式会社ManagetechはAI駆動開発を実現する会社です。生成AI関連の開発受託やソフトウェア開発マネジメントを自動化するサービスの提供を行っています。
Managetech inc.
 @managetech_inc
Aug 16, 2024

Claude のプロンプト キャッシュ機能が重要な理由 - TechTalks #PromptCaching #LLMApplications #ReduceCosts #ImproveLatency prompthub.info/37046/

0
0
0
0
11
tkhongsap's profile picture. AI & Data Strategist | Tech Enthusiastic
Kenji
@tkhongsap
Aug 18, 2024

🔄 Old Data, New Queries? No problem! 💡 AI interactions can be slow and costly—until you use prompt caching. Store context, reuse knowledge, and watch as costs drop by 90% and latency by 85%. ⚡ #AI #Coding #PromptCaching #Efficiency #AIInnovation link.medium.com/0ZaTTouK9Lb

0
0
0
1
19
Epoch_Essence's profile picture. Providing you with latest news and trends in technology at lightning speeds.
Epoch Essence
 @Epoch_Essence
Mar 3

🚨 AI API security alert! 🚨 Stanford researchers found 8/17 commercial AI APIs, incl. OpenAI, vulnerable to prompt caching timing attacks. 🔒 Prioritize user privacy over performance! #AIsecurity #PromptCaching

0
0
0
0
18
managetech_inc's profile picture. 株式会社ManagetechはAI駆動開発を実現する会社です。生成AI関連の開発受託やソフトウェア開発マネジメントを自動化するサービスの提供を行っています。
Managetech inc.
 @managetech_inc
Aug 15, 2024

Anthropic の新機能により、企業はプロンプト情報を再利用できるようになります #AIefficiency #PromptCaching #AnthropicAI #LLMperformance prompthub.info/36688/

0
0
0
0
19
DataCamp's profile picture. Learn data and AI skills from scratch with 600+ courses. Master Python, ChatGPT, SQL, Power BI, and more.
DataCamp
 @DataCamp
Dec 4

Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp

DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
0
0
5
1
1K
tkhongsap's profile picture. AI & Data Strategist | Tech Enthusiastic
Kenji
@tkhongsap
Oct 2, 2024

A cool upgrade from ⁦@OpenAI⁩ ⚡ Prompt Caching is now automatically enabled for models like gpt-4o and o1-preview. No code changes needed, just faster response times. #AI #PromptCaching #Efficiency #GPT4 #NoCode openai.com/index/api-prom…

0
0
0
0
58
razhangwei's profile picture. Staff RS@Meta AI | ML PhD | AI & LLMs | Productivity enthusiast
Wei Zhang
 @razhangwei
Aug 18, 2024

Anthropic's recent support of prompt caching got a lot of traction. Here is the original paper and its key idea. #PromptCaching #LLM #AI #ML #Anthropic #Inference

ZainHasan6's profile picture. AI builder & teacher | AI/ML https://t.co/PDkARZyitK | EngSci ℕΨ @UofT | ex-(Vector DBs, Health tech, Lecturer) | decoding AI’s future - follow for insights!
Zain
@ZainHasan6
Aug 17, 2024

An explanation of prompt caching from the paper authors I found useful: Many input prompts have overlapping text segments, such as system messages, prompt templates, and documents provided for context. Our key insight is that by precomputing and storing the attention states of…

ZainHasan6's tweet image. An explanation of prompt caching from the paper authors I found useful: Many input prompts have overlapping text segments, such as system messages, prompt templates, and documents provided for context. Our key insight is that by precomputing and storing the attention states of…
1
30
204
132
31K
0
0
2
0
47
CloudCostChefs's profile picture. 🍳 CloudCostChefs: free, no-BS recipes that slice 15-30 % off your cloud bill. #FinOps for engineers across Azure, OCI & multi-cloud. Grab the 90-day checklist
CloudCostChefs
 @CloudCostChefs
Nov 10

Claude API Prompt Caching 👨🍳 90% cost reduction ✅ 80% latency reduction ✅ Cache prompts for 1 hour ✅ Stop reprocessing the same context over and over. Prep once, reuse all day 💰 🍲 cloudcostchefs.com #FinOps #PromptCaching #CloudCostChefs

cloudcostchefs.com

CloudCostChefs - Democratizing FinOps

Free tools and resources to optimize cloud costs for everyone

Source: cloudcostchefs.com
0
0
0
0
14
clipper_video's profile picture. CUBE365 makes it quick and easy to find, create and share snackable clips from long-form videos--without any special video editing skills or tools
CUBE365 Clips
 @clipper_video
Jul 10

Applications of generative AI are evolving toward asynchronous responses, shifting from immediate needs to more agentic, complex interactions. #GenerativeAI #AIApplications #PromptCaching #CustomerCare #AITrends #TechInnovation #AIUseCases video.cube365.net/c/976533

0
0
0
0
5
clipper_video's profile picture. CUBE365 makes it quick and easy to find, create and share snackable clips from long-form videos--without any special video editing skills or tools
CUBE365 Clips
 @clipper_video
Jul 10

Prompt caching in Amazon Bedrock enhances agent efficiency and reduces costs by up to 90% for Claude and Nova models. #PromptCaching #AgentUseCases #AmazonBedrock #AIModels #ClaudeModels #NovaModels #TokenCaching #TechInnovation #AIPerformance video.cube365.net/c/976531

0
0
0
0
16
gujral_raman5's profile picture. Group Product Director - AI & Monetization @US based Fintech - I talk about sports, movies,travel stock markets, product management, and corporate life.
Raman Gujral
 @gujral_raman5
Jun 11

So, in the above example, caching made the system 3 times faster and 3 times cheaper to run. #promptcaching #AIagents #Agenticframework #GenAI #AIproductmanagement #AIproductmanager #ArtificialIntelligence #AIlearnings

0
0
0
0
12
VHurezeanu's profile picture. Better your best! Full-time dentist, free-time crypto and ultra-marathon enthusiast!
Sats0mNIaK
@VHurezeanu
Mar 25

⚡️ $Prompt caching? It’s AI magic—storing query results on-chain to slash costs and boost speed. @AIWayfinder is integrating this into Web3, making it a dev’s dream. Paired with $PROMPT staking, it’s a utility powerhouse. #PromptCaching #Web3

1
0
1
0
25
Epoch_Essence's profile picture. Providing you with latest news and trends in technology at lightning speeds.
Epoch Essence
 @Epoch_Essence
Mar 3

🚨 AI API security alert! 🚨 Stanford researchers found 8/17 commercial AI APIs, incl. OpenAI, vulnerable to prompt caching timing attacks. 🔒 Prioritize user privacy over performance! #AIsecurity #PromptCaching

0
0
0
0
18
SimonStran36407's profile picture. Scifi fan: Alien, Black Mirror, West World, The Expanse, Foundation, Terminator, Blade Runner, Pantheon, Total Recall, 5th Element, The Truman Show, Silo.
Simon Strandgaard
 @SimonStran36407
Jan 23

I'm experimenting with prompt caching using DeepSeek + LlamaIndex gist.github.com/neoneye/992bfc… The response has usage info. prompt_cache_hit_tokens=0 prompt_cache_miss_tokens=15 #DeepSeek #LlamaIndex #PromptCaching

SimonStran36407's tweet card. Inspect response from DeepSeek api. GitHub Gist: instantly share code, notes, and snippets.
Inspect response from DeepSeek api
Source: gist.github.com
0
0
0
0
45
DataCamp's profile picture. Learn data and AI skills from scratch with 600+ courses. Master Python, ChatGPT, SQL, Power BI, and more.
DataCamp
 @DataCamp
Dec 4

Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp

DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
0
0
5
1
1K
RasmusToivanen's profile picture. More generalist than specialist. Industrial engineer turned into ML. Currently AI CTO @RecordlyData. Training Finnish-LLMs end-to-end with @aapo_tanskanen
Rasmus Toivanen
 @RasmusToivanen
Nov 5, 2024

Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI

RasmusToivanen's tweet image. Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI
0
0
1
0
79
ramessarwat's profile picture. Passionate about technology and innovation. I tweet about artificial intelligence, cybersecurity, blockchain and gadgets
Rames
 @ramessarwat
Oct 24, 2024

OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2

ramessarwat's tweet image. OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2
0
0
0
0
30
BuildWithLal's profile picture. A software engineer over a decade experience in building apps, infrastructure and automate deployment processes
Lal Zada
 @BuildWithLal
Oct 4, 2024

Now, OpenAI will automatically cache longer prompts for an hour, and if they’re reused, developers will get a 50% discount on input costs! Other way to save 50% on OpenAI is using Batch Requests blog.gopenai.com/save-50-on-ope… #OpenAI #PromptCaching #SaveOnOpenAI

BuildWithLal's tweet card. In this post we are going to discuss what is OpenAI Batch API and how OpenAI Batch API can reduce the cost of tokens. Then we’ll also go…
Save 50% on OpenAI: Complete Guide to Batch Requests
Source: ai.plainenglish.io
0
0
0
0
15
0xGagan's profile picture. A self-made techpreneur who's here to tweet anything I like...
Gagan Deep Singh
 @0xGagan
Oct 3, 2024

🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.

0xGagan's tweet image. 🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.
1
0
3
0
31
tkhongsap's profile picture. AI & Data Strategist | Tech Enthusiastic
Kenji
@tkhongsap
Oct 2, 2024

A cool upgrade from ⁦@OpenAI⁩ ⚡ Prompt Caching is now automatically enabled for models like gpt-4o and o1-preview. No code changes needed, just faster response times. #AI #PromptCaching #Efficiency #GPT4 #NoCode openai.com/index/api-prom…

0
0
0
0
58
No results for "#promptcaching"
0xGagan's profile picture. A self-made techpreneur who's here to tweet anything I like...
Gagan Deep Singh
 @0xGagan
Oct 3, 2024

🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.

0xGagan's tweet image. 🚀Prompt Caching #PromptCaching allows developers to reduce costs and latency by reusing recently seen input tokens, developers can get a 50% discount and faster prompt processing times.
1
0
3
0
31
RasmusToivanen's profile picture. More generalist than specialist. Industrial engineer turned into ML. Currently AI CTO @RecordlyData. Training Finnish-LLMs end-to-end with @aapo_tanskanen
Rasmus Toivanen
 @RasmusToivanen
Nov 5, 2024

Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI

RasmusToivanen's tweet image. Has someone played around with Azure OpenAI cache using some of the models that won't return cached_tokens in the API response. Do I have to just put faith in @Azure or make some weird testing were I evaluate latencey on consecutive calls. #LLM #PromptCaching #Azure #GenAI
0
0
1
0
79
ramessarwat's profile picture. Passionate about technology and innovation. I tweet about artificial intelligence, cybersecurity, blockchain and gadgets
Rames
 @ramessarwat
Oct 24, 2024

OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2

ramessarwat's tweet image. OpenAI Prompt Caching, la nueva función en el API de OpenAI que almacena y reutiliza las solicitudes utilizadas con mas frecuencia para mejorar el rendimiento #OpenAI #API #promptcaching buff.ly/3UjVvT2
0
0
0
0
30
DataCamp's profile picture. Learn data and AI skills from scratch with 600+ courses. Master Python, ChatGPT, SQL, Power BI, and more.
DataCamp
 @DataCamp
Dec 4

Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp

DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
DataCamp's tweet image. Tired of waiting for your AI to figure it out (again)? Meet prompt caching: the trick to keeping your model sharp and efficient. Think faster responses, lower costs, and smarter workflows. 🔗 ow.ly/AH9750Ug4KC #AI #MachineLearning #PromptCaching #DataCamp
0
0
5
1
1K

Something went wrong.


Something went wrong.


United States Trends