To optimize insert speed, combine many small operations into a single large operation. Ideally, you make a single connection, send the data for many new rows at once, and delay all index updates and consistency checking until the very end.
The time required for inserting a row is determined by the following factors, where the numbers indicate approximate proportions:
Sending query to server: (2)
Parsing query: (2)
Inserting row: (1 × size of row)
Inserting indexes: (1 × number of indexes)
This does not take into consideration the initial overhead to open tables, which is done once for each concurrently running query.
The size of the table slows down the insertion of indexes by
N, assuming B-tree indexes.
You can use the following methods to speed up inserts:
If you are inserting many rows from the same client at the same time, use
INSERTstatements with multiple
VALUESlists to insert several rows at a time. This is considerably faster (many times faster in some cases) than using separate single-row
INSERTstatements. If you are adding data to a nonempty table, you can tune the
bulk_insert_buffer_sizevariable to make data insertion even faster. See Section 5.1.8, “Server System Variables”.
When loading a table from a text file, use
LOAD DATA. This is usually 20 times faster than using
INSERTstatements. See Section 13.2.9, “LOAD DATA Statement”.
Take advantage of the fact that columns have default values. Insert values explicitly only when the value to be inserted differs from the default. This reduces the parsing that MySQL must do and improves the insert speed.
See Section 8.5.5, “Bulk Data Loading for InnoDB Tables” for tips specific to
See Section 8.6.2, “Bulk Data Loading for MyISAM Tables” for tips specific to