Shift+g
is your friend. It jumps to the last line of a file in normal mode, in visual mode it will select everything along the way.
Edit: I should clarify it works best with Shift+v
line select, with Ctrl-v
and only left/right arrow keys it might constrain to the column width of the starting line, which is likely not what you're looking for.