More PGDBE questions

Use this forum for questions and answers regarding PostGreSQL and the PGDBE.
Post Reply
Message
Author
User avatar
rdonnay
Site Admin
Posts: 4775
Joined: Wed Jan 27, 2010 6:58 pm
Location: Boise, Idaho USA
Contact:

More PGDBE questions

#1 Post by rdonnay »

1. Does PostGreSQL server support transaction processing using DacSession:beginTransaction() and DacSession:endTransaction() ?

2. I am trying to DbfUpsize on the remote server but get a license error Alaska. This works fine on my development computer at home.
How are licenses applied when running on the server?

3. What is the practical limit of rows in a table using ISAM with lots of indexes? I am upsizing a table with 1,126,156 records, 91 fields and 17 index tags.
PostGreSql server slows down to a crawl about half way through the upsize. I'm monitoring the numbers of added rows with PgAdmin 4 and after 664221 records
added it can add only about 60 records per minute. I expect that to slow to a stop in a few hours. This is being done with the server and upsizer running on my workstation.
Of course, this would be much faster with PostGreSql on a fast server, but I don't know how much faster. I am wondering if this process would speed up if I upsize the data
without the indexes first and then index later with the app. Regardless, it looks like this table will need to be replaced by multiple tables in the migration. This table
records taxi driver transactions (trips) and there are approximately 3000 trips per day for the drivers managed by our app. That's about 1.25 million records per year.
I am going to do the upsize again, but this time, with no CDX. We many need to develop a completely different strategy for how we handle this much data.
BTW - there is no performance issue at all with ADS. We have been able to maintain a many as 4,000,000 records with no penalty.
The eXpress train is coming - and it has more cars.

User avatar
rdonnay
Site Admin
Posts: 4775
Joined: Wed Jan 27, 2010 6:58 pm
Location: Boise, Idaho USA
Contact:

Re: More PGDBE questions

#2 Post by rdonnay »

I am wondering if this process would speed up if I upsize the data without the indexes first and then index later with the app.
I answered my own question.
The answer is NO.

My next strategy is to write my own upsizing routine.
My guess is that Alaska is using SQL INSERT statements to upsize the data.

I'm going to write a small program that does the same but I'm going to experiment with the size of the INSERT chunks.

It would certainly be helpful if I could get some of these questions answered by Alaska Software, but alas, I have not been approved to post anything on their forum.
I am highly frustrated over the lag time in trying to get any kind of support from any developers these days.
The eXpress train is coming - and it has more cars.

Post Reply