Glossary

this topic provides ditto specific terms and their definitions, as well as links to related information a actor used by /#conflict free replicated data type (crdts) to identify the source or author of a data mutation, an actor is made up of a siteid and the site's current /#epoch apple wireless direct link an apple developed proprietary technology that establishes a point to point wi fi connection between two apple devices if available in their environment, small peers utilize awdl to create a mesh network connection and replicate data for additional details, refer to peer to peer wi fi a proprietary technology apple developed to establish point to point wi fi connection between two apple devices when available to smallpeer devices, ditto leverages awdl to establish a mesh network connection and sync data for more information, see docid\ qioiq5sti01rd0pgz7hn9 application a logical container, or namespace , that holds all the data associated with your app small peers are limited to utilizing one application concurrently, a specification included in the identity on the other hand, the big peer has the capacity to support multiple applications simultaneously application ids consist of strings, with lower case uuids being the prevalent choice application a small peer can use only one application at a time, which is specified as part of the identity the big peer can service multiple applications at a time application ids are strings, almost always a lower case uuid attachment the ditto component which deals with storing large binary files for users (associated with a document as an attachment) attachments are referenced by documents but must be explicitly downloaded attachments use a different transfer mechanism from regular replication authentication webhook an http service hosted by the developer which receives credentials and responds with metadata about the user and which permissions they should have the identity service uses this information to dynamically produce the required certificates configured through the portal awdl see /#apple wireless direct link awmap add wins map one of our crdt b backend the underlying key value store which ditto uses for database like persistence big peer broadly refers to the ditto cloud in its role "as" a peer a big peer is unique in the sense that has highly durable and scalable storage and typically greedily replicates all data from smaller peers a big peer typically deals with a company’s (or app's) entire dataset which may be substantially larger than the partial dataset any given small peer might be operating on blob store an internal component which offers general blob storage used by any internal ditto components which need to persist "files" "files" is in quotes as the blob store does not necessarily require a true filesystem and might be operating purely in memory bus a public service offered by the ditto sdk for establishing raw byte streams between peers using the ditto mesh this technology enables many use cases beyond ditto's document replication examples include voice chat, game data, syncing other non ditto dbs over our mesh network, vpn over ditto, etc under the hood it is a thin wrapper around channels byoc bring your own cloud a model for deploying the ditto platform managed by ditto in your own cloud account where you (the customer) share responsibility and control over the account and therefore the cost and security and compliance needs with ditto c ca see /#certificate authority cdc see change data capture change data capture channel a bidirectional message oriented data flow running over the top of a virtual conn these can offer reliable or lossy delivery characteristics and be opened either mutually or as a client/server type relationship channels are protocol agnostic, like tcp/udp, and are consumed by services chooser also known as the “mesh chooser”, a stateful algorithm which decides at any moment which outgoing connections we should make this considers the peers we’re currently connected to, the peers whose advertisements have been detected by transports, and past failures certificate authority the cryptographic root of trust for all identities and certificates within a ditto application originally this was a standard x 509 ca for peer tls certificates but its role has expanded to include jwt and in band certificate signatures it is by knowing the public keys of the ca that one offline peer can verify the authenticity of another offline peer collection a grouping of documents (the fundamental ditto type) under a name loosely equivalent to a table in sql terms an app may have many collections conflict free replicated data type an advanced class of data type designed to manage and replicate data changes in a way that allow multiple distributed peers to make updates concurrently without the need to reach consensus to form a single meaningful value for merge for more information, see ditto's blog post https //ditto live/blog/dittos delta state crdts crdt see /#conflict free replicated data type d database the small peer's implementation of the ditto store data transfer object represents a structured data object that contains information to be transmitted from one peer to another document a schema flexible unit of data contained in a collection; analogous to a row in a table ditto address an sdk layer type which targets some peer in the mesh for a bus connection or similar it opaquely wraps whatever identifying information is needed ditto routing protocol a custom ospf esque shortest path first interior routing protocol used to route multi hop packets within a ditto mesh uses presence as a data source dto see /#data transfer object e epoch a concept which identifies a "version" of a peer's crdt knowledge used by replication and crdt to identify whenever a peer has changed in some fundamental way that obsoletes our prior knowledge of them today, an epoch changes each time a peer performs data eviction eviction the process a peer takes to "forget" data this is different to removing data in the sense that data is not actually deleted, it is merely forgotten by the peer and jettisoned by that app important for use cases like cabin crew apps where data from the last flight is not needed on the next flight g gatt see /#generic attribute profile generic attribute profile an older, slower mode of bluetooth le data transfer which has typical speed of 3 to 6 kb/s works back to very old android and ios phones where possible the bluetooth transport upgrades a connection to l2cap h hybrid logical clock used to track when mutations occurred to a crdt, or component thereof a ditto hlc combines a physical clock portion (the local time stamp on a peer as unix milliseconds) together with a logical portion (a number unique to each peer and increases by one with each change they make) hlc see /#hybrid logical clock i identify a complex parameter passed to ditto at startup which defines how you will authenticate yourself and verify who other peers are, and whether they’re using the same application as you modes include offlineplayground, onlineplayground, onlinewithauthentication, and sharedkey some of these rely on the application having a common ca identity data the data which the ca asserts about an participant in the mesh it includes their peer key, site id, permissions, and other arbitrary data returned by the authentication webhook such as email address, job title, and so on identity service the part of the big peer which handles login requests, invoking authentication webhooks if required, and generating the cryptographic material for peers to authenticate each other by acting as the ca in code, this basically means authserver in band certificate a bespoke binary format that a certificate authority (ca) can sign to assert that a given identity data is valid and matches a particular key plays the role of a tls x 509 certificate in non tls situations k keyspace as per the random slicing algorithm, we think of the keyspace as the range 0 to 1 we take the capacity of the cluster, and divide 1 by it this determines how much of the keyspace each partition owns l l2cap see /#logical link control and adaptation protocol link an encrypted connection between two peers who are not directly connected, with traffic routed via intermediate peers used for multihop sync via query overlap groups, and ditto bus logical link control and adaptation protocol a faster mode of bluetooth le transport this is at a lower level/complexity than gatt platforms that support it have much faster speeds ( 20 kb/s) m metadata in a crdt context, metadata refers to the field by the same name in a crdt document crdt metadata tracks the actor which the current site uses when performing mutations, and tracks all the summaries for the crdt in a replication context, metadata is all the information which replication uses to keep track of the state of other peers in a ditto mesh a large part of this consists of crdt metadata as above in a storage context, metadata might refer to the internal abstraction which provides key value storage optimized for metadata using any supported ditto backend these metadata stores can be created standalone, but every also comes with a special associated metadata store for tracking backend specific info (transction numbers, version info, etc ) multiplexer a synchronous machine inside a virtual connection to a single remote peer, performing packet fragmentation and reassembly for all of the physical connections arriving from various transports o online playground a type of identity where peers do not need unique credentials to log in and everybody has read and write access to everything p peer to peer wi fi any mechanism for establishing direct wifi connections between devices without needing a router in between awdl is one such technology for apple devices, and wifi aware is another for android devices peer key a p 256 private key generated and persisted on every device that runs ditto this is the primary unique identifier for each peer and its ecdsa signatures are used to prove authenticity it is unrelated to crdt actor ids permission a specification of which documents a given peer can read or write this is presented as a list of specific collection names, and a sublist of query strings for each collection documents must match one of those dittoql (dql) queries to be readable or writable if using an online authenticated identity these can be locked down; other identity types have no ca and let everybody access anything portal self service website ( https //portal ditto live/ ) used to create and manage applications hosted on ditto’s cloud presence viewer the part of ditto responsible for building a picture of all peers in the surrounding mesh, including rich peer info such as sdk version, device names, and which transports are active this information is used as the basis for routing and can be visualized with the presence viewer r replication query a query that runs on connected peers that results in changes being sent back to the initial peer when changes are made to the remote peers' local smallpeer database s service handles channels to provide a particular functionality the most important example is the replication service, which performs document sync siteid a unique identifier for a peer which identifies any crdt document mutations they author also has been used as unique peer identifier generally, but this is being phased out in favor of the peer key subscription a query from the replication perspective, whereby one peer requests any data that matches this query from other peers to synchronize t transports the part of ditto which involves the physical transport mechanisms such as bluetooth, websockets, awdl , lan, and so on transports are concerned with finding other ditto peers and establishing secured connections these lowest level transports are then weaved together at a higher level to form a ditto mesh u unique universally stable timestamp the unique identifier assigned to every write transaction indicates its order in the sequence of events, a causal relationship to other events, conflict resolution mechanisms to handle concurrency conflicts, and enable non blocking reads z live query the object that the observe callback function returns when changes to the local database match a given query and then monitors changes to that query over time