[Date Prev][Date Next][Thread Prev][Thread Next]
[Date Index]
[Thread Index]
- Subject: Re: Reading CSV
- From: Geoff Leyland <geoff_leyland@...>
- Date: Wed, 4 Dec 2013 08:18:40 +1300
On 4/12/2013, at 7:44 am, Dirk Laurie <dirk.laurie@gmail.com> wrote:
> 2013/12/3 Geoff Leyland <geoff_leyland@fastmail.fm>:
>
>> What’s the current best option for a CSV (or tab separated, for that matter) file?
>
> Define "best”.
On 28/11/2013, at 7:59 pm, Dirk Laurie <dirk.laurie@gmail.com> wrote:
> 1. It is actively being maintained.
> 3. A certain amount of quality control is in effect.
Covering the issues I mentioned would be handy too. Maybe “handles corner cases and large files”?
> As far as I can tell, most solutions either:
>> - read the whole file in one go (constructing a table of all the values becomes
>> impractical as files get larger)
>
> Is this comment based on gut feel (I'm deliberately avoiding "prejudice"), or
> do you have an actual example where this is a problem?
Metadata for the set of NZ land parcels is over 3GB.
