Data Contract
A data contract is a formal agreement between a service and a client that abstractly describes the data to be exchanged. That is, to communicate, the client and the service do not have to share the same types, only the same data contracts. - Microsoft
The following is a set of articles around the topics of data product / contract etc. however the focus is about data contracts and expectations IMO, therefore I place it here. - by Chad sanderson
the rise of data contracts
(finally!) a guide to data contracts p1
(good) contracts, robustness in datamesh (but not only), also has about data-sharing agreements.
(good) from zero to hero
data contract experimentation - swirlai
Implementation
JSON Schema is a vocabulary that allows you to annotate and validate JSON documents, example.
protobuf & gRPC
gRPC - a basic pythonic tutorial
Protobuf - a pythonic tutorial
(good) Intro to gRPC & Protobuf by Trevor Kendrick
(good) What are Protocol Buffers and why they are widely used? by Dineshchandgr
Understanding protobufs by Daniel Padua Ferreira "Protocol Buffers (protobuf) is a method of serializing structured data which is particulary useful to communication between services or storing data. It was designed by Google early 2001 (but only publicly released in 2008) to be smaller and faster than XML. Protobuf messages are serialized into a binary wire format which is very compact and boosts performance."
protobuf what and why? by Swaminathan Muthuveerappan
off topic - how to choose between grpc, graphql, rest
managing proto files and other schema types such as avro or json schema, can be done in kafka's schema registry.
Last updated