A Golang based Open-Source, Real-Time Data Processing Platform

A opensource Real-Time Data Processing Platform

Memphis{dev} is an open-source real-time data processing platform
that provides end-to-end support for in-app streaming use cases using Memphis distributed message broker.
Memphis’ platform requires zero ops, enables rapid development, extreme cost reduction,
eliminates coding barriers, and saves a great amount of dev time for data-oriented developers and data engineers.

star Why

Working with data streaming is HARD.

As a developer, you need to build a dedicated pipeline for each data source,
work with schemas, formats, and serializations, analyze each source individually,
enrich the data with other sources, constantly change APIs, and scale for better performance.
Besides that, it constantly crashes and requires adaptation to different rate limits.
It takes time and resources that you probably don’t have.

Message broker acts as the middleman and supports streaming architecture,
but then you encounter Apache Kafka and its documentation and run back to the monolith and batch jobs.
Give memphis{dev} a spin before.

point_right Use-cases

  • Async task management
  • Real-time streaming pipelines
  • Data ingestion
  • Cloud Messaging
    • Services (microservices, service mesh)
    • Event/Data Streaming (observability, analytics, ML/AI)
  • Queuing
  • N:N communication patterns

sparkles Features

  • rocket Fully optimized message broker in under 3 minutes
  • computer Easy-to-use UI, CLI, and SDKs
  • tv Data-level observability
  • skull_and_crossbones Dead-Letter Queue with automatic message retransmit
  • abc Schemaverse – Embedded schema management for produced data (Protobuf/JSON/GraphQL/Avro)
  • chains SDKs: Node.JS, Go, Python, Typescript, NestJS
  • whalewheel_of_dharma Runs on your Docker or Kubernetes
  • man_technologist Community driven

rocket Getting Started