Abliteration
Abliteration is the practice of removing refusal behavior from an open-weight large language model by editing its weights so that the model can no longer write a "refusal direction" into its residual stream.
Explore Open Source AI through related topics and the articles other pages reference most.
Articles that also belong to these categories. Counts cover all of Open Source AI.
Showing 1-3 of 3 articles
Abliteration is the practice of removing refusal behavior from an open-weight large language model by editing its weights so that the model can no longer write a "refusal direction" into its residual stream.
TransformerLens is an open-source Python library for the mechanistic interpretability of GPT-style language models.
nnsight is an open-source Python library for the interpretation and intervention of deep learning models, developed by the Bau Lab at Northeastern University.