Page 1 of 3
Not enough memory to create a database
Posted: Sun Oct 22, 2017 10:07 am
by Eugene Lutsenko
Not enough memory to create a database.
When you open a small database CSV, then you can create a DBF file for conversion. But when the CSV file is large, assigning the structure of the database to be created in the array is obtained an empty array. Is there any command in order to free up the memory within the program? For example for arrays
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 10:31 am
by Victorio
Hi, Eugene,
How size is CSV file ?
I also converting txt files to database, but when TXT file is larger than about 1 - 1.5GB, then it is problem.
Because I break file to smaller parts (about 100Mbytes) and read it separately.
Read one part, save to dbf, close this txt part and read other.
This works for me fine, without risk of memory exhaust.
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 10:39 am
by Eugene Lutsenko
The size of the CSV file is just 670 MB. I was hoping that it will be possible to introduce it into dbf file all at once. In parts it seems to work, but I do not like
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:03 am
by bwolfsohn
create the database from a portion of the file.
then you can "append from delimited"
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:23 am
by Eugene Lutsenko
From the small part I made when I was debugging. I usually am debugging on small amounts of data and faster to check. And then, when I took a real base, it turned out that it's not working. In Total Commander you can cut the file into parts, but not more than 1000 parts. But portions were too big. Now it turns out it is necessary to cut the part into pieces... and so until until you earn
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:27 am
by Eugene Lutsenko
And Roger not have a program that converts a very large (giant) CSV files to DBF?
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:30 am
by bwolfsohn
append from "csvfilename.csv" delimited will work with any size .csv, subject to the size limitations on .dbf files.
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:32 am
by Eugene Lutsenko
bwolfsohn wrote:append from delimited will work with any size .csv, subject to the size limitations on .dbf files.
It is clear that the dbf file is < 2 GB. And could You explain to me more detail how to do this?
May be somebody knows where can I download CSV->DBF converter, which can do that?
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:54 am
by Eugene Lutsenko
Re: Not enough memory to create a database
Posted: Sun Oct 22, 2017 11:59 am
by Auge_Ohr
Eugene Lutsenko wrote:May be somebody knows where can I download CSV->DBF converter, which can do that?
what is your Problem ?
Code: Select all
USE MyDBF EXCLUSIVE
APPEND FROM XYZ.TXT DELIMITED WITH ";"