I ended up implementing a way to remove a user but keeping them in the tree, that should probably be the default action when deleting someone.
I had to because I realized that SerSleepy (npub1jk9…lqz7) is flooding wss://pyramid.fiatjaf.com/ with a million notes with ugly images but he has invited a ton of people that I don't want to remove.