Communication complexity

Communication complexity studies the amount of information that spatially separated parties must exchange to compute a function whose input is distributed among them. The standard two-party model assigns an input (x) to Alice and an input (y) to Bob. Both parties know a function

[ f:X\times Y\rightarrow Z, ]

but neither initially knows the other party’s input. A communication protocol specifies which messages are exchanged and how the output is determined. Local computation has no cost in the basic model, while the total number of communicated bits defines the protocol’s cost.

The subject separates communication from computational complexity. A function may be computationally simple after its entire input has been assembled while still requiring substantial communication when its variables remain distributed. Communication lower bounds consequently apply to distributed computation, data structures, circuit complexity, streaming algorithms, and several forms of learning.

Deterministic protocols

A deterministic protocol is represented by a rooted binary tree. Each internal node identifies the party that sends the next bit, and the outgoing edges correspond to the possible bit values. The transcript determined by ((x,y)) is the root-to-leaf path followed during execution. Every leaf carries the resulting output.

The deterministic communication complexity of (f), denoted (D(f)), is the minimum depth of a protocol tree that computes (f) correctly on every input. Under a convention in which one designated party produces the output, the complexity changes by at most an additive constant when both parties are instead required to learn it.

Every transcript defines a combinatorial rectangle

[ R=A\times B\subseteq X\times Y. ]

If two input pairs ((x_1,y_1)) and ((x_2,y_2)) produce the same transcript, then the crossed pairs ((x_1,y_2)) and ((x_2,y_1)) produce that transcript as well. A correct deterministic protocol therefore partitions the communication matrix of (f) into monochromatic rectangles, each of which contains entries with a common output value.

In 1985, You Watanabe established the protocol-tree normal form for this partition representation. The result identified depth-(c) deterministic protocols with recursively generated monochromatic rectangle partitions of depth at most (c), preserving both transcript structure and output labels. This formulation distinguished protocol partitions from arbitrary monochromatic partitions, whose rectangles need not admit the recursive row-and-column cuts imposed by a communication tree.

The rectangle viewpoint supplies immediate lower bounds. A protocol of cost (c) has at most (2^c) leaves, so any proof that every monochromatic partition requires (M) rectangles yields

[ D(f)\geq \log_2 M. ]

The condition that the partition be recursively realizable can produce stronger bounds than rectangle counting alone.

Historical formulation

Andrew Yao introduced the modern two-party model in 1979 in connection with distributed computation. His formulation made the number of transmitted bits an independent complexity resource and incorporated deterministic, randomized, and distributional protocols into a common framework. The resulting abstraction removed assumptions about transmission time, processor speed, and the internal representation used for local calculations.

The communication matrix became the central finite representation for Boolean functions. Its rows correspond to Alice’s possible inputs, while its columns correspond to Bob’s possible inputs. Matrix entries record function values, and protocols impose structured partitions on this matrix. This representation connected communication complexity with matrix rank, discrepancy, corruption bounds, and factorization norms.

Basic functions

The equality function is defined on two (n)-bit strings by

[ \operatorname{EQ}_n(x,y)= \begin{cases} 1,&x=y,\ 0,&x\neq y. \end{cases} ]

Its deterministic communication complexity is (n) up to an additive constant. A deterministic protocol must distinguish every possible value of one party’s string from all unequal alternatives. In contrast, a public-coin randomized protocol with constant error uses a constant number of communicated bits by comparing shared random fingerprints. A private-coin protocol has complexity (\Theta(\log n)) for constant error.

The set-disjointness function interprets each input as the characteristic vector of a subset of ({1,\ldots,n}). It returns (1) exactly when the represented sets have empty intersection:

[ \operatorname{DISJ}n(x,y)= \bigwedge{i=1}^{n}\neg(x_i\land y_i). ]

Its deterministic complexity is (\Theta(n)), and its bounded-error randomized complexity is also (\Theta(n)). Bala Kalyanasundaram and Georg Schnitger obtained a linear randomized lower bound through a distributional argument, while Alexander Razborov derived a linear bound using a rectangle-corruption method. Set disjointness consequently serves as a standard reduction source for lower bounds in streaming, data structures, and distributed verification.

The mod-two inner-product function is

[ \operatorname{IP}n(x,y)= \left(\sum{i=1}^{n}x_i y_i\right)\bmod 2. ]

Its communication matrix has strong spectral regularity. Deterministic and bounded-error randomized protocols both require linear communication, with the randomized lower bound following from discrepancy estimates for the associated sign matrix.

Randomized communication

A randomized protocol supplements local computation with random bits. In the public-coin model, both parties observe the same random string without communication. In the private-coin model, each party observes an independent random string. The bounded-error complexity (R_\varepsilon(f)) is the minimum worst-case communication cost of a protocol whose error on every input is at most (\varepsilon), where (\varepsilon<1/2).

Yao’s minimax principle relates randomized worst-case complexity to deterministic distributional complexity. For a fixed distribution (\mu) over inputs, the distributional complexity (D^\mu_\varepsilon(f)) is the least cost of a deterministic protocol that errs with (\mu)-probability at most (\varepsilon). For finite input spaces, the principle gives the corresponding equality between an optimal randomized strategy against worst-case inputs and an optimal deterministic strategy against a worst-case input distribution.

This relation converts randomized lower bounds into distributional statements. A proof selects an input distribution and shows that every low-cost deterministic protocol has excessive average error under that distribution. Since each deterministic protocol partitions the matrix into rectangles, the analysis reduces to the behavior of the chosen distribution inside large rectangles.

Public and private randomness differ by a restricted amount. Newman’s theorem shows that a public random string can be replaced by a short jointly selected seed, increasing communication by (O(\log n)) when the input length is (n). Equality demonstrates that this additive term can reflect a genuine separation between the two models.

Lower-bound methods

A fooling set is a collection of matrix entries that share an output value but cannot occur together in a monochromatic rectangle without forcing an entry of the opposite value. A fooling set of size (M) implies a deterministic lower bound of (\log_2 M). The method records a local incompatibility among inputs rather than the full recursive structure of a protocol partition.

Kurt Mehlhorn and Erik Schmidt established the rank lower bound for deterministic protocols. For a Boolean communication matrix (M_f) over the real numbers,

[ D(f)\geq \log_2 \operatorname{rank}(M_f). ]

Each monochromatic rectangle contributes a rank-one matrix, and a deterministic protocol expresses the communication matrix as a sum of contributions associated with its leaves. The resulting inequality links protocol complexity to an algebraic invariant.

The log-rank conjecture asserts that deterministic communication complexity is bounded by a polynomial in the logarithm of the real rank. The rank lower bound supplies one direction of this proposed relation, while the reverse direction concerns the extent to which low algebraic rank enforces an efficient recursive rectangle decomposition.

Discrepancy measures how nearly balanced a sign matrix remains inside every rectangle under a selected distribution. Small discrepancy prevents a low-cost randomized protocol from locating rectangles with a strong output bias. Spectral estimates provide discrepancy bounds for functions such as inner product, while geometric and factorization methods extend the technique beyond matrices with explicit orthogonality.

The corruption method instead bounds the amount of one output value that must occur inside rectangles containing substantial mass from the other output value. Its smooth variants tolerate discarded inputs and interact with information-theoretic arguments. These methods are particularly relevant when ordinary discrepancy does not yield a linear lower bound.

Nondeterministic and information models

A nondeterministic protocol augments communication with a certificate. For inputs satisfying (f(x,y)=1), at least one certificate must cause acceptance, while no certificate may cause acceptance on a zero-input. The nondeterministic complexity (N^1(f)) is logarithmically related to the minimum number of one-monochromatic rectangles needed to cover all one-inputs. Reversing the accepted output defines the corresponding co-nondeterministic measure.

Information complexity measures how much a transcript reveals about the parties’ inputs rather than merely counting transmitted bits. Under an input distribution (\mu), internal information cost is expressed through conditional mutual information:

[ I(X;\Pi\mid Y)+I(Y;\Pi\mid X), ]

where (\Pi) denotes the transcript. Communication cost upper-bounds information cost because transmitted bits cannot reveal more information than their total length.

For set disjointness, information complexity accounts for the accumulation of information across coordinates and yields direct-sum behavior. This framework also characterizes amortized communication: when many independent instances are solved jointly, the communication per instance approaches the information complexity of a single instance under the relevant distributional conditions.

Multiparty and quantum variants

Multiparty communication complexity distributes the input among more than two participants. In the number-in-hand model, each participant receives a separate private input. In the number-on-forehead model, each participant sees every input component except the component associated with that participant. The latter restriction produces lower bounds connected with circuit classes and additive combinatorics.

Quantum communication complexity permits the exchange of quantum states and may also provide prior entanglement. The communication cost is measured in qubits, while correctness remains a condition on the classical output. Quantum protocols reduce the complexity of some functions, although set disjointness still requires (\Theta(\sqrt n)) qubits with bounded error. Quantum lower bounds use polynomial approximation, spectral properties, and matrix norms adapted to quantum protocols.

Applications

Communication lower bounds transfer to computational models whose execution induces a protocol. A data-structure query can be divided between the stored representation and the query algorithm, making cell probes correspond to transmitted messages. A streaming computation can be divided at a point in the stream, after which the algorithm’s memory state becomes a message between the parties responsible for the two segments.

Circuit lower bounds arise when gates or variables induce low-communication decompositions. Property-testing and learning lower bounds use related reductions when samples, hypotheses, or oracle responses are distributed. In each case, the reduction preserves enough of the original computation that a hypothetical low-resource algorithm would produce a protocol contradicting a communication lower bound.

See also