Git bump get actual git dir for worktree

When using worktrees, we can not assume the .git directory exists inside toplevel. Instead use the appropriate git command.

Also avoid fetching all remotes and branches. I think we can assume that people will already have the commit locally to manually test the bump.