decodeGroupAmount

Turn a byte array (from the script stack) into a group amount