Is there a workable solution to importing large datasets into a DB in server connect?

[Apple]

@famousmag

I suppose this is a matter of memory… This huge amount of data is loaded on memory taking so much place of it and then the memory resources are low for processing!

Although memory could play a role, the most notable performance bottleneck is actually what I described here:

Slow insert records into the database

Actually, I’ve just realized how slow is the Database Multi Insert in Wappler, even with transactions as mentioned in my previous post. I did the same test using a third-party SQL viewer, with the import feature, and it basically transforms the CSV into a bulk INSERT statement: INSERT (...) VALUES (...), (...), (...), (...), (... about 300) INSERT (...) VALUES (...), (...), (...), (...), (... about 300) // instead of Wappler: INSERT (...) VALUES (...) INSERT (...) VALUES (...) INSERT (...) VAL…