Lol. I just popped a slaves head right off for not obeying me, I know the feeling.
I should ask: These aren't visitor raiders, are they? Your troops are have the prefix Raider but their suffix is their rank and only distinguishing feature, i.e, Recruit, Prospect, Veteran, Elite. So if it states Raider Survivor or just Raider, then they are visitors. Also, I think there is such a thing as Raider Veteran in the wild, which can cause some confusion. I know it might seem like a silly question but I was asked it, so think of it as a right of passage, lol. Also, certain plots can have visitors, like specific Wasteland Venturers and Uits Maniacal Machinations. These additional settlers can be switched off in the holotape by selecting visitors. I forget what category but shouldn't be too hard to find.
Another thing: If they are troops at a Vassal, they can only guard and patrol. That might cover your issue with that. I think this can be changed by going into the holotape settings > conqueror > allow troops to work on plots or something like that, I don't remember.
Last thing though. Were you playing on a save from a conqueror version about 2-3months old? I updated from one and had to restart because I had an issue with soldiers being nonassignable but it seemed that there was a major glitch. My game didn't even recognize them as troops and I couldn't invade anything.
Actually, one more thing. Lol.
@Phil_T_Casual once pointed out that if you want to update a city your should follow these steps:
"To properly remove/change a city plan I find it needs to be done twice.
I use the the local self destruct in the holo, once it completes > fast travel away > return and use the scrap option with the Townhall Gravel > fast travel away > return and use the clean this settlement option in the holo > fast travel away > build the new city plan upon return."
It helps and if you want to see where that came from:
https://www.simsettlements.com/site/index.php?threads/abernathy-and-changing-city-plans.10433/
Things have got pretty involved now, so jumping into this mod after a couple of years there seems to be a bit of a learning curve. I think mainly because when it has hangups, they aren't the same as the normal ones we get from Vanilla FO4.
Good luck.