Hello,

For categories you need to set alphabetic order via listing type:

Listing Type > your type > Edit > Category Settings > Category sorting type > Alphabetic

then go to Common > Refresh...