load-data-infile

sometimes, I have to re-import data for a project, thus reading about 3.6 million rows into a MySQL table (currently InnoDB, but I am actually not really limited to this engine). "Load data infile..." has proved to be the fastest solution, however it has a tradeoff: - when importing without keys, the import itself takes about 45 seconds, but the key creation takes ages (already running for 20 minutes...). - doing import with keys on the table makes the import much slower There are keys over 3 fields of the table, referencing numeric fields. Is there any way to accelerate this? Another issue is

I am running into a permission error when trying to load data from a flat file database dump into a new table. I know that the schema of the file and my table is the same and I tried tweaking the permissions. What else should I try? mysql> load data infile 'myfile.txt' into table mytable fields terminated by ',' enclosed by '"'; ERROR 1045 (28000): Access denied for user 'user'@'%' grant all on mytable.* to 'user'@'% Here's a thread on the MySQL forums that discusses exactly this. Here's the answer, posted by Ken Tassell Problem resolved using the command below: grant file on *.* to kentest

I use MySQL queries all the time in PHP, but when I try LOAD DATA INFILE, I get the following error #1045 - Access denied for user 'user'@'localhost' (using password: YES) Does anyone know what this means? I just ran into this issue as well. I had to add "LOCAL" to my SQL statement. For example, this gives the permission problem: LOAD DATA INFILE '{$file}' INTO TABLE {$table} Add "LOCAL" to your statement and the permissions issue should go away. Like so: LOAD DATA LOCAL INFILE '{$file}' INTO TABLE {$table} Yamir Encarnacion I had this problem. I searched around and did not find a satisfactory

I've got a CSV file with 11 columns and I have a MySQL table with 9 columns. The CSV file looks like: col1, col2, col3, col4, col5, col6, col7, col8, col9, col10, col11 and the MySQL table looks like: col1, col2, col3, col4, col5, col6, col7, col8, col9 I need to map the columns 1-8 of CSV file directly to the first 8 columns of the MySQL table. I then need to skip the next two columns in the CSV file and then map column 11 of CSV file to column 9 of MySQL table. At the moment I am using the following SQL command: LOAD DATA LOCAL INFILE 'filename.csv' INTO TABLE my_table FIELDS TERMINATED BY '

I have created a database and a table. I have also created all the fields I will be needing. I have created 46 fields including one that is my ID for the row. The CSV doesn't contain the ID field, nor does it contain the headers for the columns. I am new to all of this but have been trying to figure this out. I'm not on here being lazy asking for the answer, but looking for directions. I'm trying to figure out how to import the CSV but have it start importing data starting at the 2nd field, since I'm hoping the auto_increment will fill in the ID field, which is the first field I created. I

I need a way to easily export and then import data in a MySQL table from a remote server to my home server. I don't have direct access to the server, and no utilities such as phpMyAdmin are installed. I do, however, have the ability to put PHP scripts on the server. How do I get at the data? I ask this question purely to record my way to do it lewis You could use SQL for this: $file = 'backups/mytable.sql'; $result = mysql_query("SELECT * INTO OUTFILE '$file' FROM `##table##`"); Then just point a browser or FTP client at the directory/file (backups/mytable.sql). This is also a nice way to do