Navigate to Administration | General and choose Trigger severities in the drop-down in the upper-right corner:

In this section, we can customize severity labels and their colors. As the information box at the bottom of this page says, changing severity labels will require updating translations that anybody might be using in this Zabbix instance.