Maximum known-good value for MaxMsgs
in a JetStream stream
#7032
Unanswered
asymmetric
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
I'm exploring using NATS JetStream to store data that should ~never be discarded, so that it can be picked up and replayed from the beginning by any new consumer.
The data is very small (~100B), so the metadata overhead would be quite large, but given its tiny size I was considering running a stream without a
MaxMsgs
-- or a very large one, that would allow me years of runway before hitting any hard limits.The stream would have a
LimitsPolicy
and R3 replication.The numbers we're talking about would be ~ 5M messages stored in one stream per year, amounting to ~0.6GB (considering data and overhead).
What are the practical limitations about this setup? How long before I'd hit a hard limit?
Are there people who have configured streams in such a way, and what were the pitfalls?
Beta Was this translation helpful? Give feedback.
All reactions