Address spaces are in ascending order, but for writing numbers, place value is in *descending* order. In my opinion, the little-endian byte order gets it technically right by having a consistent and logical order, just ascending. The big-endian byte order mixes the two, with addresses increasing but byte "place-value" descending.
#endianness #computing #ISA
Besides, executables are generally produced from a very high level, from a compiler. Why add complexity and subjectiveness to make hex dumps easier to read (for example)?