Support of the AMQP protocol ?

[olivierauverlot]

Hi,

Is it possible to consider adding support for the AMQP protocol to integrate SQLPage with RabbitMQ?

This would allow us to either publish messages to a queue or consume messages in order to implement asynchronous processing. For example, a .sql file could be executed when a message is detected in a queue (via a callback).

I think SQLPage functions like sqlpage.* would be useful to define the desired behavior. In Rust, there is a library for AMQP (https://github.com/amqp-rs/lapin).

We have this need to make certain processing steps more reliable, or to set up workflows. I believe this is a fairly common use case in information systems.

What do you think?

Best regards
Olivier :)

[lovasoa]

Hi !
Responding here to both #1351 and #1350.

Both of these sound interesting, but maybe a little niche ? Adding new dependencies increases the maintenance cost, the binary size, compile times, vulnerability exposure area, etc... When the new feature is going to be useful to a significant proportion of sqlpage users, then it's worth it.

Are you sure amqp and ldap wouldn't be better handled by just letting users call native binaries with sqlpage.exec. It could be as simple as

set result = 
    sqlpage.exec(
        '/usr/local/bin/rabbitmqadmin',
            '--host', 'localhost',
            '--port', '15672',
            '--username', 'guest',
            '--password', 'guest',
            'publish',
            'exchange=amq.default',
            'routing_key=myqueue',
            'payload=Hello from SQLPage'
    ) AS result;

[olivierauverlot]

I understand your hesitation about adding new protocols. Regarding RabbitMQ, within organizations that have large information systems like the university where I work, this kind of architecture is becoming increasingly common. We need to process workflows asynchronously and reliably. SQLPage is already incredibly effective for handling data with a DBMS, but the ability to use it for subscribing to and publishing message queues would open up many possibilities by enabling data exchange with external processes.