Thanks to the forum’s auto-bump feature, this article came up today which answers everything! 
My issues were
- The column was set to utf8mb4 but the database wasn’t
- The global database connection wasn’t set to be utf8mb4.
With step 2, remember to set it for each of your targets!