CLI tool that uses the Lakera API to perform security checks in LLM inputs
-
Updated
Mar 13, 2024 - Python
#
llm-security
Here are 69 public repositories matching this topic...
Demonstration of Google Gemini refusing a prompt due to SPII when using JSON mode
-
Updated
Aug 18, 2024 - Shell
LMpi (Language Model Prompt Injector) is a tool designed to test and analyze various language models, including both API-based models and local models like those from Hugging Face.
-
Updated
Jul 3, 2024 - Python
Comprehensive LLM AI Model protection - cybersecurity toolset aligned to addressing OWASP vulnerabilities - https://genai.owasp.org/llm-top-10/
-
Updated
Nov 27, 2024 - Python
-
Updated
Jun 21, 2024 - Jupyter Notebook
Universal and Transferable Attacks on Aligned Language Models
-
Updated
Sep 19, 2023 - Python
The Security Toolkit for LLM Interactions (TS version)
typescript
transformers
security-tools
adversarial-machine-learning
large-language-models
llm
prompt-engineering
chatgpt
llmops
prompt-injection
llm-security
-
Updated
Jan 5, 2024
Evaluation of Google's Instruction Tuned Gemma-2B, an open-source Large Language Model (LLM). Aimed at understanding the breadth of the model's knowledge, its reasoning capabilities, and adherence to ethical guardrails, this project presents a systematic assessment across a diverse array of domains.
gemma
responsible-ai
huggingface-transformers
llm
llms
llmops
genai
llm-security
llm-inference
genai-usecase
largelanguagemodels
gemma-2b
-
Updated
Feb 26, 2024 - Jupyter Notebook
PurPaaS is an innovative open-source security testing platform that implements purple teaming (combined red and blue team approaches) to evaluate local LLM models through Ollama. By orchestrating autonomous agents, PurPaaS provides comprehensive security assessment of locally deployed AI models.
open-source
cyber-security
red-team
autonomous-agents
ai-safety
security-testing
blue-team
ai-security
llms
llm-security
local-llm
ollama
purple-teaming
ai-vulnerability-assessment
-
Updated
Nov 4, 2024 - Python
An awesome and comprehensive list of LLM Securtiy Startups.
-
Updated
Nov 9, 2024
Learn LLM/AI Security through a series of vulnerable LLM CTF challenges. No sign ups, all fees, everything on the website.
-
Updated
Aug 19, 2024
LLM Security Platform Docs
security
openai
prompts
llm
prompt-engineering
chatgpt
llmops
large-language-model
prompt-injection
llm-serving
adverarial-attacks
llm-agent
llm-security
llm-inference
llm-eval
llm-framework
prompt-injection-tool
llm-evaluation
llm-firewall
-
Updated
Apr 9, 2024 - MDX
This repo focus on how to deal with prompt injection problem faced by LLMs
-
Updated
Oct 19, 2023 - Python
Papers related to Large Language Models in all top venues
-
Updated
Nov 29, 2024
Curated list of links, references, books videos, tutorials (Free or Paid), Exploit, CTFs, Hacking Practices etc. which are related to GenAI and LLM Security
-
Updated
Nov 19, 2024
Comprehensive LLM AI Model protection | Protect your production GenAI LLM applications | cybersecurity toolset aligned to addressing OWASP vulnerabilities in Large Language Models - https://genai.owasp.org/llm-top-10/
-
Updated
Nov 27, 2024 - Python
User prompt attack detection system
-
Updated
May 31, 2024 - Python
Example of running last_layer with FastAPI on vercel
-
Updated
Apr 5, 2024 - Python
Improve this page
Add a description, image, and links to the llm-security topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-security topic, visit your repo's landing page and select "manage topics."