The Robert E. Lee Descendant Who Spoke at VMAs Has Left His Church Following Backlash From Congregation