||Re: complex indexes vs index key fields
Akshat Kapoor <firstname.lastname@example.org>
||Tue, 28 Jul 2020 15:06:34 +0530
>> I then tried to append the data from my DBF file to the server but
>> that is taking forever, about 350 records per minute... can I
>> interrupt the append process without corrupting teh database? can you
>> suggest a more efficient way to load data to the database server?
> I don't use MySQL but I could insert the 7577 records in the test data
> you sent me into Firebird in 45 seconds. That's not particularly fast
> but it's a bit quicker than 3.6 hours at 35 records per minute. :-)
> MySql is known to be geared more to reading speed rather than writing
> speed but 35 records a minute is ridiculous. There has to be a way of
> speeding things up. Akshat can be of more help here than I can as I
> don't use MySql but if you show us how you load the data perhaps we can
Good Afternoon Mervyn,
It is 350 records per minute not 35 records
And that even is slow by MYSQL standards.
The difference could be due to execution 1 query for every row, and this
indeed slows down speed.
Inserting more than 1 row in the same query will probably be taking the
same time. If not the same time then an increase of just single digit %.
I did change a code from row by row processing to bulk processing and
time improvement was considerable. I did not time the old and new ones
but it was something like 10+ minutes to approx 1 minute.