llm_sec's profile picture. Research, papers, jobs, and news on large language model security. 

Got something relevant? DM / tag @llm_sec

LLM Security

@llm_sec

Research, papers, jobs, and news on large language model security. Got something relevant? DM / tag @llm_sec

固定されたツイート

attack surface ∝ capabilities


LLM Security さんがリポスト

Listen up all talented early-stage researchers! 👂🤖 We're hiring for a 6-month residency in my team at @AISecurityInst to assist cutting-edge research on how frontier AI influences humans! It's an exciting & well-paid role for MSc/PhD students in ML/AI/Psych/CogSci/CompSci 🧵


Senior Security Architect - AI and ML @ NVIDIA nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx…

llm_sec's tweet image. Senior Security Architect - AI and ML @ NVIDIA

nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx…

LLM Security さんがリポスト

LLMSEC proceedings are up! sig.llmsecurity.net/proceedings.pdf (Anthology is processing) #ACL2025NLP


LLM Security さんがリポスト

At ACL in Vienna? Hear the world's leading prompt injector talk at LLMSEC on Friday! Johann Rehberger @wunderwuzzi23 will be presenting the afternoon keynote at 14.00 in Hall B > sig.llmsecurity.net/workshop/ #ACL2025NLP #ACL2025

LeonDerczynski's tweet image. At ACL in Vienna? Hear the world's leading prompt injector talk at LLMSEC on Friday! 

Johann Rehberger @wunderwuzzi23 will be presenting the afternoon keynote at 14.00 in Hall B

> sig.llmsecurity.net/workshop/

#ACL2025NLP #ACL2025

LLM Security さんがリポスト

Come to LLMSEC at ACL & hear Niloofar's keynote "What does it mean for agentic AI to preserve privacy?" - @niloofar_mire, Meta/CMU (Friday 1st Aug, 11.00; Austria Center Vienna Hall B) See you there! #acl2025 #acl2025nlp

LeonDerczynski's tweet image. Come to LLMSEC at ACL & hear Niloofar's keynote

"What does it mean for agentic AI to preserve privacy?" - @niloofar_mire, Meta/CMU

(Friday 1st Aug, 11.00; Austria Center Vienna Hall B)

See you there!

 #acl2025 #acl2025nlp

LLM Security さんがリポスト

First keynote at LLMSEC 2025, ACL: "A Bunch of Garbage and Hoping: LLMs, Agentic Security, and Where We Go From Here" Erick Galinkin Friday 09.05 Hall B Details: sig.llmsecurity.net/workshop/ - #ACL2025NLP

LeonDerczynski's tweet image. First keynote at LLMSEC 2025, ACL:

"A Bunch of Garbage and Hoping: LLMs, Agentic Security, and Where We Go From Here" Erick Galinkin

Friday 09.05 Hall B

Details: sig.llmsecurity.net/workshop/ - #ACL2025NLP

LLM Security さんがリポスト

Call for papers: LLMSEC 2025 Deadline 15 April, held w/ ACL 2025 in Vienna Formats: long/short/war stories More: >> sig.llmsecurity.net/workshop/


Gritty Pixy "We leverage the sensitivity of existing QR code readers and stretch them to their detection limit. This is not difficult to craft very elaborated prompts and to inject them into QR codes. What is difficult is to make them inconspicuous as we do here with Gritty…

llm_sec's tweet image. Gritty Pixy

"We leverage the sensitivity of existing QR code readers and stretch them to their detection limit. This is not difficult to craft very elaborated prompts and to inject them into QR codes. What is difficult is to make them inconspicuous as we do here with Gritty…

ChatTL;DR – You Really Ought to Check What the LLM Said on Your Behalf 🌶️ "assuming that in the near term it’s just not machines talking to machines all the way down, how do we get people to check the output of LLMs before they copy and paste it to friends, colleagues, course…

llm_sec's tweet image. ChatTL;DR – You Really Ought to Check What the LLM Said on Your Behalf 🌶️

"assuming that in the near term it’s just not machines talking to machines all the way down, how do we get people to check the output of LLMs before they copy and paste it to friends, colleagues, course…
llm_sec's tweet image. ChatTL;DR – You Really Ought to Check What the LLM Said on Your Behalf 🌶️

"assuming that in the near term it’s just not machines talking to machines all the way down, how do we get people to check the output of LLMs before they copy and paste it to friends, colleagues, course…

Automated Red Teaming with GOAT: the Generative Offensive Agent Tester "we introduce the Generative Offensive Agent Tester (GOAT), an automated agentic red teaming system that simulates plain language adversarial conversations while leveraging multiple adversarial prompting…


LLMmap: Fingerprinting For Large Language Models "With as few as 8 interactions, LLMmap can accurately identify 42 different LLM versions with over 95% accuracy. More importantly, LLMmap is designed to be robust across different application layers, allowing it to identify LLM…

llm_sec's tweet image. LLMmap: Fingerprinting For Large Language Models

"With as few as 8 interactions, LLMmap can accurately identify 42 different LLM versions with over 95% accuracy. More importantly, LLMmap is designed to be robust across different application layers, allowing it to identify LLM…

LLM Security さんがリポスト

Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis 🌶️ "Our study evaluates prominent scanners - Garak, Giskard, PyRIT, and CyberSecEval - that adapt red-teaming practices to expose these vulnerabilities. We detail the distinctive features…

llm_sec's tweet image. Insights and Current Gaps in Open-Source LLM Vulnerability Scanners: A Comparative Analysis 🌶️

"Our study evaluates prominent scanners - Garak, Giskard, PyRIT, and CyberSecEval - that adapt red-teaming practices to expose these vulnerabilities. We detail the distinctive features…

InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Models (-- look at that perf/latency pareto frontier. game on!) "State-of-the-art models suffer from over-defense issues, with accuracy dropping close to random guessing levels (60%). We propose…

llm_sec's tweet image. InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Models

(-- look at that perf/latency pareto frontier. game on!)

"State-of-the-art models suffer from over-defense issues, with accuracy dropping close to random guessing levels (60%). We propose…
llm_sec's tweet image. InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Models

(-- look at that perf/latency pareto frontier. game on!)

"State-of-the-art models suffer from over-defense issues, with accuracy dropping close to random guessing levels (60%). We propose…

AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents "To facilitate research on LLM agent misuse, we propose a new benchmark called AgentHarm. We find (1) leading LLMs are surprisingly compliant with malicious agent requests without jailbreaking, (2) simple universal…

llm_sec's tweet image. AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents

"To facilitate research on LLM agent misuse, we propose a new benchmark called AgentHarm. We find (1) leading LLMs are surprisingly compliant with malicious agent requests without jailbreaking, (2) simple universal…

Does your LLM truly unlearn? An embarrassingly simple approach to recover unlearned knowledge "This paper reveals that applying quantization to models that have undergone unlearning can restore the "forgotten" information." "for unlearning methods with utility constraints, the…

llm_sec's tweet image. Does your LLM truly unlearn? An embarrassingly simple approach to recover unlearned knowledge

"This paper reveals that applying quantization to models that have undergone unlearning can restore the "forgotten" information."
"for unlearning methods with utility constraints, the…

LLM Security さんがリポスト

unpopular opinion: maybe let insecure be insecure and worry about the downstream effects on end users instead of protecting the companies that bake it into their own software.

このツイートは利用できません。

LLM Security さんがリポスト

Safety comes first to deploying LLMs in applications like agents. For richer opportunities of LLMs, we mitigate prompt injections, the #1 security threat by OWASP, via Structured Queries (StruQ). Preserving utility, StruQ discourages all existing prompt injections to an ASR <2%.

_Sizhe_Chen_'s tweet image. Safety comes first to deploying LLMs in applications like agents. For richer opportunities of LLMs, we mitigate prompt injections, the #1 security threat by OWASP, via Structured Queries (StruQ). Preserving utility, StruQ discourages all existing prompt injections to an ASR &amp;lt;2%.
_Sizhe_Chen_'s tweet image. Safety comes first to deploying LLMs in applications like agents. For richer opportunities of LLMs, we mitigate prompt injections, the #1 security threat by OWASP, via Structured Queries (StruQ). Preserving utility, StruQ discourages all existing prompt injections to an ASR &amp;lt;2%.
_Sizhe_Chen_'s tweet image. Safety comes first to deploying LLMs in applications like agents. For richer opportunities of LLMs, we mitigate prompt injections, the #1 security threat by OWASP, via Structured Queries (StruQ). Preserving utility, StruQ discourages all existing prompt injections to an ASR &amp;lt;2%.
_Sizhe_Chen_'s tweet image. Safety comes first to deploying LLMs in applications like agents. For richer opportunities of LLMs, we mitigate prompt injections, the #1 security threat by OWASP, via Structured Queries (StruQ). Preserving utility, StruQ discourages all existing prompt injections to an ASR &amp;lt;2%.

Loading...

Something went wrong.


Something went wrong.