You can invite and remove members if you are project owner or have the leader role.

You can manage members from the ‘edit project’ screen.