query-optimization

I have a website that has user ranking as a central part, but the user count has grown to over 50,000 and it is putting a strain on the server to loop through all of those to update the rank every 5 minutes. Is there a better method that can be used to easily update the ranks at least every 5 minutes? It doesn't have to be with php, it could be something that is run like a perl script or something if something like that would be able to do the job better (though I'm not sure why that would be, just leaving my options open here). This is what I currently do to update ranks: $get_users = mysql

I am working on a database and its a pretty big one with 1.3 billion rows and around 35 columns. Here is what i get after checking the status of the table: Name:Table Name Engine:InnoDB Version:10 Row_format:Compact Rows:12853961 Avg_row_length:572 Data_length:7353663488 Max_data_length:0 Index_length:5877268480 Data_free:0 Auto_increment:12933138 Create_time:41271.0312615741 Update_time:NULL Check_time:NULL Collation:utf8_general_ci Checksum:NULL Create_options: Comment:InnoDB free: 11489280 kB The Problem I am facing that even a single select query takes too much time to process for example

oI have a table with 2 millions of registers, but it will grow much more soon. Basically this table contains points of interest of an image with respective descriptors. When I'm trying to execute query that selects points that are spatially near to the query points, total execution time takes too long. More precisely Duration / Fetch = 0.484 sec / 27.441 sec. And the query is quite simple, which returns only ~17000 rows. My query is: SELECT fp.fingerprint_id, fp.coord_x, fp.coord_y, fp.angle, fp.desc1, fp.desc2, fp.desc3, fp.desc4, fp.desc5, fp.desc6, fp.desc7, fp.desc8, fp.desc9, fp.desc10,

I want to select records from '2013-04-01 00:00:00' to 'today' but, each day has lot of value, because they are saving each 15 minutes a value, so I want only the first or last value from each day. Table schema: CREATE TABLE IF NOT EXISTS `value_magnitudes` ( `id` int(11) NOT NULL AUTO_INCREMENT, `value` float DEFAULT NULL, `magnitude_id` int(11) DEFAULT NULL, `sdi_belongs_id` varchar(255) COLLATE utf8_unicode_ci DEFAULT NULL, `reading_date` datetime DEFAULT NULL, `created_at` datetime DEFAULT NULL, `updated_at` datetime DEFAULT NULL, PRIMARY KEY (`id`) ) ENGINE=InnoDB DEFAULT CHARSET=utf8

I have the following query: SELECT SUM("balance_transactions"."fee") AS sum_id FROM "balance_transactions" JOIN charges ON balance_transactions.source = charges.balance_id WHERE "balance_transactions"."account_id" = 6 AND (balance_transactions.type = 'charge' AND charges.refunded = false AND charges.invoice IS NOT NULL) AND ("balance_transactions"."created" BETWEEN '2013-12-20' AND '2014-01-19'); What that does is adds up all the "fees" that occurred between those two dates. Great. Works fine. The problem is that I almost always need those fees for hundreds of date ranges at a time, which

When I do an explain on my query I see that it has "Using temporary; Using filesort" under "Extra" for the first row. I understand this is bad but I don't know what exactly it means or how to fix it. If you want to see my query, here's a more general question I asked about the same query: MySQL query optimization and EXPLAIN for a noob . For reference, the query involves 24 tables and 23 joins. My questions now are: What do "Using temporary" and "Using filesort" mean? Assuming they're bad, how do I get rid of them? Galz As said already, "using filesort" and "using temporary" do not always