NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
-
Updated
Nov 12, 2025 - Python
#
safety
Here are 238 public repositories matching this topic...
Open-source vulnerability disclosure and bug bounty program database
legal data hackers bug-bounty safety simplicity responsible-disclosure safe-harbor-framework security-research vulnerability-disclosure disclosure-policy bug-bounty-hunters
-
Updated
Jul 20, 2025 - Python
PyBullet CartPole and Quadrotor environments—with CasADi symbolic a priori dynamics—for learning-based control and RL
control reinforcement-learning quadcopter robotics symbolic gym cartpole safety quadrotor robustness pybullet casadi
-
Updated
Nov 6, 2025 - Python
Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback
reinforcement-learning transformers transformer safety llama gpt datasets beaver alpaca ai-safety safe-reinforcement-learning vicuna deepspeed large-language-models llm llms rlhf reinforcement-learning-from-human-feedback safe-rlhf safe-reinforcement-learning-from-human-feedback
-
Updated
Sep 8, 2025 - Python
List of resources about programming practices for writing safety-critical software.
-
Updated
Mar 11, 2025 - Python
Safe reinforcement learning with stability guarantees
-
Updated
Feb 8, 2022 - Python
Safe Bayesian Optimization
-
Updated
Nov 14, 2022 - Python
Deploy once. Continuously improve your AI agents in production.
-
Updated
Nov 7, 2025 - Python
Decrypted Generative Model safety files for Apple Intelligence containing filters
-
Updated
Oct 22, 2025 - Python
Jax Official Implementation of T-RO Paper: Songyuan Zhang*, Oswin So*, Kunal Garg, Chuchu Fan: "GCBF+: A Neural Graph Control Barrier Function Framework for Distributed Safe Multi-Agent Control".
-
Updated
Jun 3, 2025 - Python
A collaborative collection of open-source safe GPT-3 prompts that work well
-
Updated
Mar 12, 2022 - Python
Safe Exploration with MPC and Gaussian process models
-
Updated
Aug 17, 2020 - Python
面向中文大模型价值观的评估与对齐研究
-
Updated
Jul 20, 2023 - Python
[arXiv:2311.03191] "DeepInception: Hypnotize Large Language Model to Be Jailbreaker"
-
Updated
Feb 20, 2024 - Python
[ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
-
Updated
Mar 30, 2025 - Python
Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)
-
Updated
Jun 29, 2023 - Python
Safety Verification of Deep Neural Networks
-
Updated
Feb 5, 2018 - Python
Improve this page
Add a description, image, and links to the safety topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the safety topic, visit your repo's landing page and select "manage topics."