Top all-time · #5779
PeerDB Blog
Company blog · blog.peerdb.iodatasystems
PeerDB Blog is the company blog at blog.peerdb.io, writing about data and systems. Since 2023, 13 different Hacker News readers have linked it 64 times, most often “Five tips on Postgres logical decoding”. It is still writing: the last post was on 2024-11-25, and you can follow it by feed.
At PeerDB, we are building a fast, simple and the most cost effective way to stream data from Postgres to Data Warehouses, Queues and Storage engines.
Most-linked posts?
- Five tips on Postgres logical decoding4 people · 5 mentions · first linked 2023-12-13
- Row-level transformations in Postgres CDC using Lua3 people · 6 mentions · first linked 2024-05-08
- Simple Postgres to ClickHouse replication featuring MinIO3 people · 3 mentions · first linked 2024-05-02
- SSH Tunneling for Secure Postgres Replication3 people · 3 mentions · first linked 2024-01-17
- Postgres to ClickHouse Real Time Replication Using PeerDB2 people · 5 mentions · first linked 2024-02-14
- Real-Time Change Data Capture from Postgres 16 Read Replicas2 people · 3 mentions · first linked 2023-12-21
- ClickHouse acquires PeerDB for native Postgres CDC integration2 people · 3 mentions · first linked 2024-07-30
- Exploring versions of the Postgres logical replication protocol2 people · 2 mentions · first linked 2024-04-01
What Hacker News says?
Planned failovers can be managed through maintenance windows by recreating replication slots before maintenance ends. Unplanned failovers require resyncs, which are heavily optimized with PeerDB ( https://blog.peerdb.io/parallelized-initial-load-for-cdc-bas... ). With PG17+, this shouldn’t be an issue due to failover slots. Another important observation: Aurora Postgres, which is used by many customers, persists slo…
Comment linking /parallelized-initial-load-for-cdc-based-streaming-from-postgres
on “Reliably replicating data between Postgres and ClickHouse”Submitted Moving a billion Postgres rows on a $100 budget as a story · 153 points
HN discussionWell written post! However I'd like note that, we commonly hear from users that Debezium for Postgres CDC is hard to setup, manage and less flexible around data format (only json and avro). It requires at least a few months of effort to put to production. We at PeerDB ( https://github.com/PeerDB-io/peerdb ) are trying to solve this problem. We already have a connector out for Azure Event Hubs https://blog.peerdb.io/…
Comment linking /enterprise-grade-replication-from-postgres-to-azure-event-hubs
on “How to stream PostgreSQL CDC to Kafka and use Propel to get an instant API”Submitted Parallel Snapshotting: make pg_dump and pg_restore multi-threaded per table as a story · 83 points
HN discussionGreat question. Yes it does. PeerDB keeps track of what rows have been streamed and what are yet to be streamed. During failures (restarts, crashes etc), it uses this to resume from where it left off. More details on how we do it can be found in this blog - https://blog.peerdb.io/using-temporal-to-scale-data-synchron...
Comment linking /using-temporal-to-scale-data-synchronization-at-peerdb
on “Launch HN: PeerDB (YC S23) – Fast, Native ETL/ELT for Postgres”Submitted Reducing BigQuery Costs as a story · 76 points
HN discussionSubmitted Comparing Postgres Managed Services: AWS, Azure, GCP and Supabase as a story · 68 points
HN discussionSubmitted Exploring versions of the Postgres logical replication protocol as a story · 51 points
HN discussionSubmitted Overcoming pitfalls of Postgres logical decoding as a story · 35 points
HN discussionSubmitted Row-level transformations in Postgres CDC using Lua as a story · 18 points
HN discussionSubmitted ClickHouse acquires PeerDB for native Postgres CDC integration as a story · 16 points
HN discussionSubmitted Simple Postgres to ClickHouse replication featuring MinIO as a story · 12 points
HN discussionSubmitted Exploring versions of the Postgres logical replication protocol as a story · 10 points
HN discussionSubmitted Show HN: Lua for row-level transformations during Postgres CDC as a story · 5 points
HN discussionSubmitted Lua based row-level transformations during Postgres CDC as a story · 4 points
HN discussionSubmitted Querying BigQuery from Postgres with extensive push-down as a story · 4 points
HN discussionSubmitted Benchmarking Postgres Replication: PeerDB vs. Airbyte as a story · 4 points
HN discussionSubmitted Postgres to ClickHouse Real Time Replication Using PeerDB as a story · 3 points
HN discussionSubmitted ClickHouse acquires PeerDB for native Postgres CDC integration as a story · 3 points
HN discussionSubmitted Row-level transformations in Postgres CDC using Lua as a story · 3 points
HN discussionSubmitted Row-level transformations in Postgres CDC using Lua as a story · 3 points
HN discussionSubmitted Fast, Simple Postgres to ClickHouse Replication as a story · 3 points
HN discussionSubmitted Show HN: Low Latency Replication from Postgres to ClickHouse Using PeerDB as a story · 3 points
HN discussionSubmitted Five tips on Postgres logical decoding as a story · 3 points
HN discussionSubmitted Optimizing Postgres Replication Using Column Exclusion as a story · 3 points
HN discussionSubmitted Simple Postgres to ClickHouse replication featuring MinIO as a story · 2 points
HN discussionSubmitted Using Temporal to Scale Data Synchronization at PeerDB as a story · 2 points
HN discussionSubmitted Show HN: Monitor Postgres Replication Slots via Slack as a story · 2 points
HN discussionSubmitted Monitor Postgres Replication Slot Growth in Slack as a story · 2 points
HN discussionSubmitted ClickHouse acquires PeerDB for native Postgres CDC integration as a story · 2 points
HN discussion
