Large Txt or data file

tcgoh

Active Member
Licensed User
Hi Erel,

I have a very large text file with about 20,000 lines of data (about 2.3mb), should I convert them to SQlite? If not it takes A very long time to load the data on PPC in order to extract and read the data.

Thanks for your help.

Regards
TC
 

Erel

Administrator
Staff member
Licensed User
What is the data format in the text file?
Using SQL there is no need to first load all the data, therefore it is much more efficient when working with large databases.
 

tcgoh

Active Member
Licensed User
Hi Erel,

My text file with Data look's something like this, but with about 20,000 lines,

View attachment 129

Sorry if the attachment look's very small. Hope you can help.

Thanks
TC
 

Erel

Administrator
Staff member
Licensed User
I recommend you to add all the data to a table and save it to SQL using CreateSQLTable method (from the SQL library).
 
Top