Schedule - FOSDEM PGDay 2016

Logical decoding for applications: Solr full-text search in near-real time with pglogical

Date: 2016-01-29
Time: 15:20–16:10
Room: Hotel
Level: Intermediate

Logical decoding in PostgreSQL 9.4+ was added to support logical replication - but you can use also it to supply a continuous database change stream to external applications.

With the pglogical_output plugin this is now approachable for people who aren't experts in the PostgreSQL backend and writing extensions. You don't even need to know C.

Feed database changes into a business intelligence system, send them to a message queue, stream them to a write-once secure audit log, send them to an intrusion detection system... wherever you need a change stream from your database you can use logical decoding.

As an example I will use the new pglogical_output plugin and psycopg2's coming support for the logical replication protocol to feed changes from a selection of tables to Apache Solr for near-real-time full-text indexing and search.


Craig Ringer