Is there a performant, atomic way to “dequeue” from a table and see if the table is empty in MySQL?

Question

I have a table to store state for an SQS queue that is accessed from multiple processes. The way that it works now is that all messages in the queue are added to the table.