Webgriffe – Which queue manager to use?

Webgriffe

Tailored Digital Works webgriffe.com | @webgriffe

• 5+ Years of Experience with Magento
• 5 Certified Developers (Zend & Magento)
• 350+ Customers
• 20+ Magento Extensions
• 450+ Extensions Sold

Which queue manager to use?

The ones we can easly integrate with Magento are:

• Beanstalk (kr.github.io/beanstalkd)
• Amazon SQS (aws.amazon.com/sqs)
• Gearman (gearman.org)

Lilmuckers_Queue Extension

Defining a Queue Backend (for example Beanstalk)

<?xml version="1.0"?>
<!-- app/etc/local.xml -->
<config>
    <global>
		...
        <queue>
            <backend>beanstalkd</backend>
            <beanstalkd>
                <servers>
                    <server>
                        <host>127.0.0.1</host>
                    </server>
                </servers>
            </beanstalkd>
        </queue>
		...
    </global>
</config>

Lilmuckers_Queue Extension

Defining a Queue

<?xml version="1.0"?>
<!-- app/code/local/MyVendor/MyModule/etc/config.xml -->
<config>
...
    <queues>
        <queueName>
            <label>The Queue Name</label>
            <class>module/queueHandler</class>
            <workers>
                <taskName>
                    <class>module/worker</class>
                    <method>methodName</method>
                </taskName>
            </workers>
        </queueName>
    </queues>
...
</config>

Lilmuckers_Queue Extension

Adding tasks to Queue

$_queue = Mage::helper('lilqueue')->getQueue('queueName');
$_task = Mage::helper('lilqueue')->createTask(
	'taskName',
	array('data'=>'to provide', 'to'=>'the worker'),
	$storeToRunAs
);

// Optionally
$_task->setPriority(100)
    ->setDelay(60)
    ->setTtr(60);

$_queue->addTask($_task);

Lilmuckers_Queue Extension

Worker

class My_Module_Model_Worker extends Lilmuckers_Queue_Model_Worker_Abstract
{
    public function methodName(Lilmuckers_Queue_Model_Queue_Task $task)
    {
        //get the store assigned with the task
        $store = $task->getStore();
        //get the queue handler for this queue
        $queue = $task->getQueue();
        //get the data assigned with the task
        $data = $task->getData();
        //This task ended properly
        $task->success();
        //this task needs to be repeated
        $task->retry();
        //this task errored and we should drop it from the queue
        $task->hold();
        //this worker is taking a long time, we should extend it
        $task->touch();
    }
}

$ php /path/to/magento/shell/queue.php --watch <queues>