I have found something similar to my UI design here: Intuitive interface for Composing Boolean Logic?
The problem I am having is I want to have a lot of functionality inline. In this example, the user can add new groups and have children or items within those groups. The bottom child group you can see two buttons above "Group Type*". The left bottom is to select an existing group and the right button is to make it a new group with a saved name for reuse. If the user does not choose either option, then the group will only exist within the context of the parent group. The lock button as you can see is when a user chooses an existing group. The user has to manually "unlock" the group to acknowledge that the group will be changed everywhere it is referenced.
The problem is that all of this functionality is very overloaded and quite messy. Just the line with the group name can have so many different possibilities. This is a very hard problem to solve I have found out, but I was wondering if anyone has any suggestions. I thought about making editing of groups open in a new "tab" so the user can edit the group in isolation. I don't know if this will really solve the problem though.
I am open to any and all feedback. Let me know if you have questions, thank you.