Add explicit to_factor levels
Adds extra levels to a to_factor without changing existing assignments.