You can invite and remove members if you are project owner or have the leader role.
You can manage members from the ‘edit project’ screen.