Towards Safety and Helpfulness Balanced Responses via Controllable Large Language Models
CoRR(2024)
Abstract
As large language models (LLMs) become easily accessible nowadays, the
trade-off between safety and helpfulness can significantly impact user
experience. A model that prioritizes safety will cause users to feel less
engaged and assisted while prioritizing helpfulness will potentially cause
harm. Possible harms include teaching people how to build a bomb, exposing
youth to inappropriate content, and hurting users' mental health. In this work,
we propose to balance safety and helpfulness in diverse use cases by
controlling both attributes in LLM. We explore training-free and fine-tuning
methods that do not require extra human annotations and analyze the challenges
of controlling safety and helpfulness in LLMs. Our experiments demonstrate that
our method can rewind a learned model and unlock its controllability.
MoreTranslated text
AI Read Science
Must-Reading Tree
Example
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined