The game doesnt properly save some colors for tops such as Huit's cleavage clothes for example, but uses the latest used one instead. A way to work around this and not having to fix the colors every time you restart is to put a save of the same character, but with vanilla clothes with those colors you want that top clothing mod to have in front of that save ;)