[aprssig] High speed datbase inserts (feedback/ re-think)

Andrew Rich (VK4TEC) vk4tec at tech-software.net
Wed Mar 2 01:32:22 EST 2005


Ok I tried telnet to my source and insert into directly into mysql.

This works great UNTIL ... you do any other database activity on the
table. The perl script cannot insert (even delayed) and bombs out.

Maybe the telnet overruns ? I don't know.

Some solutions I see are

1) Write to temp file and get mysql to copy from temp into real table
(mysqlcopy ?)

2) Write to flat files and mysqlimport into the real table. (csv files)

3) Use RAM some how (hash tables ?)

I have never been here before and it is intersting to see you script
flying past on one screen inserting data, and then as soon as you do a
select on the table, the insert script halts and dies (sometimes it
recovers) sometimes it does not.

Cheers Andy vk4tec





More information about the aprssig mailing list